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ABSTRACT . - 

Xy the Study was designed to develop a weighted _ 

checklist for use in selecting instructional ihaterials for _) 
handicapped students • Selection: criteria, identified by 24 autliors 
were reviewed and consolidated into a 103-itein field tist survey 
which was then adapted^ according. to suggestions of a 15-ineinber review 
panel. A survey was sent to 1^559 individuals responsible for 
material selection for special education students. Ss' responses were 
summarized according to mean importance rating for each item, and 
results were used to create a weighted mater ials check list. . 

Demographic irifdrmatipri solicited from, respondents was used to 

develop a data base that included descriptions of the sample type and 
age of the -students for whom the mater ials were selected ,^ 
respondents* positionSjr sources used to gbtain information about 
instructional materials^ settings in which niateriai^ and 
employment of check lists to select materials. (Author/CL) 
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* ABSTRACT 

The primary objective of the study'was to develop a weighted check- 

_ . . . . _ • . r - . 

list designed for Use in selecting instructional materials for handi- 
capped students. Selection crit&ria identified by 24 authors were - 
reviewed and consolidated into a 103- item field- test survey. The field- 
te^^t survey was reviewed by a 15-member review panel and modified in 
accordance with theirl^reconmendations . State and local directors of ^ 
special education programs were asked to assist in the identification 
of a national sample qf; individuals responsible' for selecting instruc- 
tional materials for spi||:ial education students . A 104-item research 

survey was sent to 1659 subjects identified by lo^al directors of spe- 

' \ V ^ ' _ _ _ _ 

cial education pi;ograms. \ Subjects were asked to indicate on a scale 

u ■ . 

from 1 (low) to lO (hi^h) the anxjont of ijnportance they assign to the 
identified criteria for materials selection when choosing instructional 
materials for students rec^^iving special education services. A mean 
*'mpDrtance rating and standard deviation was calculated for each surye> 
item. Survey iteiie were rank-ordered from most to least important and ; 
proportionate scale weights based on means were assigned to each survey 
item in order to create a wei ghted instructional materials checklist. 

Demographic information sol i cited from survey respondents was used 
to develop a data base on which future research could be conducted. In- 
cluded in the data base was ia descriptipn of the sample population in 

. ' _ ^ _ • _ _ 

terms of type and age of student . for whom materials are selected. Sub- 
jects were queried regarding their positidn(s) in school district, sources 
used to obtain information about instructional materi-als, the settings in 
which the materials they select are used, anil tlieir use of checklists to 



n 



select iriateri^is. In addition subjects were asked to indicate if they 
had received forma T coursework or training in the selection of instruc- 
tibhal materials and their perceptions of the value of that training; 
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^ CH/V'-TER I * ; ; . 

INTRODUCTION 

For the past 20 years efforts havq^been Undertaken to assess and 
validate the effectiveness of ihstructidnal materials (Kdmdski S^Ofiesh* 

* 1972). One aspect of this process involves the applicatidii of system-* 
atic procedtires for. maki/ig Appropriate decisions about the selection of 
instructional materials'. Among the numerous' articles; addressing this 

• topic (Bleil,. 1975; Boland, 1976; Ct5h:.en, Alberto; and TroutmanV 1979; 
Junka'la,- 1970; McLaughlin & Trlica, 1976; Watson & VanEtten, 1976; 

*Wil-son. 1978; MfederholfS McNutt, 1977), most offer guidel ines for 
systematic instructional materials selection, either through the use , of 
vchecklists or through suggested questions tg be considered. Inherent 
in all these articles is the nation that the educational needs of handi- 
capped students wt11 be better met if they are provided with instruc-^^ 
tional materials- that have been selected in a systematic manner Pathfer 
than a haphazard fashion: _ 

The degree to which instructional materials are used In the class- 
room^was emphasized in ah investigation conducted by Educational Pro- 
ducts Irtformatiorf Exchange (ERIE) during 1974-1975. The study revealed 
that' 90-95% of the instruction in regular education programs involved 
the use of- either print or nohpriht ins tructiwfal materials (ERIE, 1977):, 
It'is assumed that usage figures for speria] education students would 
l|e comparable i , . . ' , 

The relationship between teaching antt ihstructibnal materials was 
s ■ ' ' ' . - ' 

described as i nseparable. by Cohen et al , (1979) who statec|^-tfiat: 

: 1 ■ - ' 
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^ . the teacher and teaching: materials cannot sejDarafed. • . * 

* 'A material can successfuT as ah iristructiorial aid only 
wHeh its selection and appl icatibh ar^ based on analysis 
of "tts structural cdmpdnehts . By asking relevant questions^ - * 
the teacher provides students with a material that is sys- 
tematically designed to increase learning' dpppjrtuni ties . 
Attention to sound pedagogic prijiciples when selecting 
or developing a material will eliminate wasteful spendingi 
unnece;s§ary production, and irrelevant use of ins tructidnal 
.time. (p. 11) * • • 

The Passage of PL 94-142, The Education for .All Handicapped Chll- 
dren'Act of 1975, 'assured handicapped students the rigfjt to a free, 
appropriate, public education. The role of instructional materials in . 
the implementation of the Act was explained by Lance (1977): 
If 'We are" to actualize the concepts implied ^n Public Law 
94-142, we must be ab^e to assess children in a wide range 

s.*_ ■_ . . _^ ■_ 

of skills and under all sorts of conditions, state objec- 
tives in behavioral terra , match needs to curricular needs, . ; 

analyze and sequence le.arning tasks, locate and obtain the • ^ 
;proper media, evaluate and report perfonnance, and orrthe 
' basis of feedback] make apprd^riate program revisions. . — ; • 

^(p. 95) ' _ > ■ . ^ 

If the provision of appropriate educational material^is implied 
in P.b,. 94-i42's definition 0\f provision of an appropriate education, 
individuals responsible for ^choosing such materials might be held ac-- 
^countable for their choices in this respect. Thus, it wblild be advah-. ' 
■ tagedbs for school systems to be able to^dbcumerit that i hstruqtibnal - 
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matenals^ere chosen to meet identified annual and short tqnri goals in 
the basis of a soand'^selection process. 

Perusal of the literature advocating systematic selection of iri^ 
structlonal materials reveals certain comnon criteria updn which to 
base purchase decisions (e.g., learner needs , teacher needSi time con- 
straints, price, etc.). To date, however, no ^research has been found 
that examines whether or not, teachers or other -i ndi viduals responsible 
for selecting instructional materials use systematic processes in making' 
such decisions. Furthermore, none of the selection systems .developed 
thus far provides the potential purchaser of instructional materials * 
with a rating scale which can be used to compare the materials under 
cbrisideratioh. While checklists arrd selection forms offer useful guide- 
lines for the selection of instructional inaterials , the final decision 
to choose a given piece of material is still dependent upon the sub- 
jective judgment of the person responsible for materials selectioii. If 
traditional materials checklists are used, it is not known whether a 
certain material was selected for us-e with handicapped stude^hts solely 
on the, basis of its price or beQause field-test data indicate that the 
material ' has proven Effective with a Tfmilar popul ation . 

A numerical rating system for selecting instructional materials 
wou>d he.lp the practi tidher avoid the purchase of what Bleil (£975)^ 
identified as the "most expensive mat^riaT^,ybu will even buy, ..those 
whic+i don't work" (p.; 24). Considej^ihg the avail abi 1 i ty of approximately 
, 500,000: nojiprint and 5.060 print Wtructional materials on the market 
(EPiE, ;977) the potential for making iflcorrect choices is great. 

The current research project, was undertaken for the purpose of de- 
veloping a selection procedure that would allovJ practitioners to select 



materjals for handicapped students on the basis of obaective criteria^ 
rather than subjective jud^Sient'. To this end^ the instrument would 
offer not only criteria for.decision making, but also weighting sys- 
tem that would yield numerical ratings desi^ned^'td facilitate t^e de- 
cision making .process. ^ . ^ 

Purpose * 

As a part of the study, a survey was conducted of a national sampl 
bf individuals responsible for selecting instructional materials for ^ 
special education studehts; The intended oulcome of the ^e^earch pro- 
ject was the development bf ah i hstructtonal materials selection check- 
list th^t contained both selection criteria and indices of the relative 
levels of importance assighed.by subjects to those selection criteria. 

Information was solicited from respondents to provide the basis 
for the analyses bf the following questions: ' 
1. What were the mean importance ratings assigned ,tb 
identified selection criteria by subjects? 
- 2. Wf|^at were th^meah impbrtahce ratings assigned to 
identified selection criteria by expert reviewers? 

3. What was the correlation between mean importance \ 
i ratings assigned to .selection criteria by subjects 

and expert review§S"s? . . -\ ^ 

4. For what types of students did subjects report 
Selecting instructional materials? . . 

5. Mhni percentage of survey respondents selected 
materials for elementary-age, secondary-level 
students, or both age groups? 
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6. What positions in school districts or cddperatiVe^ 
were held by individuals responsible for selecting 
instructional materials? 

7. What percentage of individuals Selecting ihstrUctibhal 
materials for special education studenl| reported havthg 
completed fornijil coursework oV^received training in th> 
area? 

7 _ 

8. What percentage of subjects indicated that; they con- 
sidered formal coursework or. training in the selection^ ^ 
of instructional materials to be of value? 

' 9'. What sources did subjects report using to obtain 

information about instructional ^materials . 

_ • __ _____ 

19. What percentage of individuals selecting instructional ^ - 

materials reported usihg^a checklist 5r a materials 

selection form when making selection decisions? 

11. In what settings were the selected ihstrucfional 

materials used? ^ , 

Answers to the above research questions represent a starting point 

for determining thk practices used in the selection of instructional 

• » 

materials for handicapped students. Furthermore, results of subjects' 
responses provide teacher trainers with information about practitioners* 
opinions of the need for additional training in the selection of in- 
structional materials- for handicapped students. 

t * . __^ ______ L_ L ; 

For the purpose of the present research, the term "handicapped 
stddehts" refers tO' any student receiving special education services. 



The jjrbduct resdlting from this project represents ah ihitial sfep 
in "the development of -j^h instrument designed to provide practitioners 
with a more objective means of assessing the value oj ihstructibhal 
materials for special education' students. 

4 



CHAPT£R II ^ ; 

, < REVIEW OF THE LITERATURE 

_ One need only exam jne the increase in the nunibeV of corifnercially 
available materials to begin to appreciate the difficulty e^iucators 
experience when ^selecti ng ihstructidnal materfals for student use, 
Komoskf (1978) reported that in the early 1950 's the HUmbW of cdntmer- 
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cially available print and^onprint materials ranged fpm 19^000 to 

» ^ ' ' ' \ 

.26, 000. A study conducted by the Educatidnal . Products I nformatioh .Ex- 
change (ERIE), (1977)' revealed that by 19>6 apprdximately 500*000 pieces 
of nonprint and 5,000, pieces of print instructional^iatefials we^e on 
the raarket. These figures represent the number of materials designed 

f^ students in grades K-12. To date, no information has been pub-^ 

• __ L< 

lished regarding , the number of available materials designed specifically 

_ , ' . ^ 

,for special education students. 

■ ■■' ^ ■ . 

The amount of timi students spend using instructional materials ^ 
provides strong evidence of the importance of such materials in school 
programs. Thus, it has been estimated that 90-95% of ^11 classroom- in- 
struction involves the use of some type of instructional material (Komoski 
1978^. Although these percentages represent regular-class situations, it 
isjassumed that instructional materietls, usage in special edueatioh pro- 
grams is comparable. , • ^ 
*1 In spite of the documented importance of i hs tructibhal materials^ 
the literature suggests that only a meager prbpbrtibfi of school budgets 
is expended for the purchase of such materials. Wbpdbury (1978)* for 
exarrij3le, repbrtetf"that approximately 1% bf educatibnal budgets is use<i 

7 . 
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for materials purchases; ^xfetort by' the National Educatibh Association . 
(1976)" showed that the "outlay for the items 1 abeletf tejctbOOks has ^drbppe'd ^ 
♦from 1.1 percent to an abysmal 0,7 percent of the annual expenditure for 
■ each pupil" (p. 51). Jhe -sam^ document rep'or ted that "statistical series 
frequently show another item labeled other teaching-materials arid .report/ 
a per-pupil expendi tUrfe -of 2-3 percent of the total per-pupil expenditure" 
(p. 51). These figures may be contrasted to the*^ recommendations of the ' 

Joint Committee Of^the National Education Association, and the Association- . 

- • |_ - 

of American Publishers which called for at least 5 percent of national 

4 _ _ _ _ ' ■ ' ■ , . ■ ■■ 

average per-pupil Operating costs<^-*e spent for instructi'dnal materials. 

Given the rapid increase in the number of instructional iriaterials 

available and the cdncomitaht low budget al locations for. these resources, 

it is not surprising that huirjerbUs articles in educational journals have 

addressed the need for instructional materials to Be carefull^y selected 

using sound evaluation criteria. In a discussion of the nee^^ for teachers ^ 

to assume an active role-,in the selectii^ arid evaluation of i ns tructiorial 

materials for the handicapped, Donnant (1979) outlined some of the prob- ^ 

lems teachers eTicounter in this process. Amorig the p»^lems identified 

were the following: * 

1. teachers actually spencT'lUtle time selectirig iri- 
structional , materials for handicapped studerits; 

2. neither teachers nor teacher trainers, have con- ^ ^ 
sidered the selection of instructional materials ; 
to be a high priority training need; 

\ __ .__ : _ _ _ • .»*' 

in many school* systems teachers are nat allowed nor 
expected to be^^ari active jDarticipant in the process 
of selecting ihstructioriai materials for their students; 
arid ^ * 
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^ some research has suggested that teachers do not have 

the neG^ssap^<?kills to select 1ns tructibnal materials. 

The above qrobtems^were identified as a result of researcfj' carried- out 



using samples of the practices of- regular cl assroom^ teachers and, thus, ^ 
do hot necessarily reflect the practices of special education teachers. 
Therefore, there is a need "to examine the needs, attitudes, and"^^-^^ , 

- • - - : * ' _ _ ' > 

havior of special education teachers -wi th regard to the selection of 
i-nstruetional'^niateY'ials'' '{p- 229). ' 

i - . / J 

. Guidelines for Selecting Instructional Material 

~ __ . . __ . ' . . ~ ' _ ____ _ 

Some of the first efforts at encouraging teachers to systematically 
I examine teaching materials ^ere the result of the establishment of tW"^ 

Special Edueatibn Instructional Materials Center fSEIMC) Network. "A 

■ # ■ . '" . _ ■_ ' _ _ _ _ * _ 

maadr objective of the Iristructibhal Materials Center Network is to 

provide the special education confTluriity with reliable irvformatibn cbh- 

^' - : . A - . - J--- -.- V. - - ■- -- 

cernMug the effectiveness df instructidrial methods' arid materials" (Mbssi 



1968. p. 303). ' * ' - ^ ■ 

' In ke'epirig with this objective* many- articlaes 'cbritairii rig suggested 

* selection and evaluatiori procedures were written by either SEIMC staff : 

... i . . . . ^- - _ - " ' _ \ J 

members or consul tants while the network was operatiorial " <j 
The literature describing. materials, selection processes may^biB 

%>• ._ ' - y ^ \ __ _J::_:__:__ 

roughly divided into "two broad categories—i t^ms seeking to^ographf cal 

• datai 9ucS a$ the typp of students wltHf^ whom the material is b^ing used, 
age of, students, subject being^ taught,! etc. ^ and items seeking teachers' 
ireactions' to the materials suqh as, *ttpw relevant was the materiaf for 
your instructional need§?- "Wouia you use tfie materfal again?" (Latham; 

■ ■ ■■ ■> ■ , ■ - : ^ ' ■ ■■ , ■,: . 



1974, p. 11). Within the "teache| r^actioh category" Lathaiii differ^ri- 

J" . _ . . _ 

tiated between items seeking teachers' perceptidhs of the practical as- 
petts.of the material versus its instructional value. Latham (1974) 

__1 - _r_ _ _ J 

Stated that a central probTem associ^ed with existing approaches to 

i - - * . ' ... . ^- • - ■ . 

« determining the value of instructional nfaterials is the failure of such 
instritments to mSa^ure the worth of instructional materials. Instru- 
ments cuflFently in use are only capable of measuring teacher perceptions 




of ±he worth of materials and, therefore, should be regarded as "User 

react\ions" rather than "mateFials evaluationi' (Latham, 1974, p. 11) 

/_ ' _ 1 ._ _ • 

^ In addition to attempting to Systematically examine the extent to 

_ ^ _ _ _ ___ V _ ^ _ _ _ ■_ _. 

which instructional- me^erials ^evaluation instcuments measure the in- 
structional value of materials, Latham measured ^ teacher reactions to 
'filling out materials evaluati&^^onns. 



The teachers suryeyed responded that only 27 percent of the items 
on materials evaluation fowns 



information that is of interest to 
them. Further, tHe teachers were requ^^ed to list the "practical and 
instructional characteristics" that we^ most important to them when 
selecting materials. Oh the basis of this information a^ist of the 
12 most frequently mentibheH practical and i nstructibhal characteristics 
^as developed. ' V 

Latham offered the followilig suggestions cbricerhihg the develjijD- 
Cient of ^n instructional materia\^s evalijatibn ihstrument: ^^^^ 



/ 



r. 



attention should be given to the develdpftieHt of all 
instrument that reflects teacher concerns; 
the shorter the instrument the better-"pr^eT*ably less 
than one 8^ X 11 page in length; 



- y 
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3. . it is advisable to avoid instrUmerits that require- 

. . . • _ : .; , _ ^ 

wcitteri ^spbrises---the teacher should be able to^ 

_ '/i _ _ . . . ■ ' * ••' * 

V check the items listed; 
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the . instrumeht shoes d be a "heat, typeset^ easy -to 
read* easy >td look at iristfument" ; arid • ,^ 

'if possible the instriinlerit shdUlti cdritairi rib more than .. 
■ 10-12 items, (p. 13) • ^ ^ . ' - 

. In order to collect teacher evaluatidris of iristructidrial materials* 

- - . - ^ . _ ^ " _ _L 

Latham proposed a system for Intermittent data §atheriri§ designed td de- 
crease the number of evaluation forms teachers were require.d td complete 
An important aspect of Latham's method of materials evaluation was the " 
— ^ phasis on <fehe need to recognizis that, typicallyi teacher invalvemeat 
in the evaluation process has been "one-way: .... away from them" (p. 14). 
•Latham contended that if teathers are expected*to provide input into' 
the- evaluation'process, they also -must be recipients of accumulated 
data. Qtherwise, i t is doubtfut that they will ever use that data to 
select^ ins tructiorial materials. . ' . - 

Qiven Latham's appeal to more fully involve teachers in the pro- 
cess of evaluating iristruetianal materials, it is interesting to note 
that his concluding statement rbmairis uriheeded, "once teachers- have 
such data (that) they can or will use those data to modify their inter- 
action with instructional materials" (p, l'5), 

-■- - - 

Ward (1968) proposed the foil owing five questibris as a startirig 
pbirit for teachers abbUt tb select iristructibrial materials for their 
studerits: * 

1. Dbes the material br device have sufficient attract^^e- 

, 4 _ _ . _ _ _. _ _ _ _ _ _ _ _ _ _ \ 

riess br curiosity value for the childreri ybu teach? 
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' - _ _ _ _- - _ - _ _ _ __::^>_^__ 

2. Does the material lead to learnings oi^ accomplishments 

• " which are in the mainstream of your pupils' needs? 

3. ' Are the contents arid subject 'matter of the materials ^ * 

accurate' arid' relevarit? 
, 4. Does the teachirig vaiqe justifj^the cost of the^aterial? 
" 5. . cfen the materials or the prbcedures which the mate Finals * 
suggest be adapted td^etter meet individual orMocal 
j needs? (p., 22) , " , . : ' 

Above all. Ward implored teachers to maintain a s^nse of objectivity 
'] and to "be the competerit prdfessibrial who 'selfects and uses -i nstructiqfial 
; materials in order to increase .the learriirig of children" (p. 23).^ - ^ • 
^'^ clrane and Abt (JL969)* devised a system whereby curriculum materials 

» ---- -■ -- *^ -- ■ - - - -- ' - - ♦ - - - 

' ■ for secondary-level students ^coul d be selected ori the basis of numerical 

■ " ■ : . . ' ' . _ - 

ratings* Four ;areas--coverage; appropriateness* motivatibri* arid cost- 
were identified as the major criteria for selection decisions. Majbr 
and minor .subi:omponents for each of these areas were also identified. 
Thus, a teacher could rate an instructional material on a scale betweeri 
0 arid 290 points. In addition, the authors' provided student arid teacher 
questionnaires to aid in determining preferences for curriculum materials. 

Unfortunately, Brarie and Abt did not describe how the^ fiJUr criteria 
or thre major and minor subcomponents were chosen, nor did they explain 
hbW weights were assigned to each of the selection criteria, ^ Further- 
mrsy rib eviderice was provided of the reliability and validity of the ; 
selectibri prbcess. However, ' despite the shortcomings of their selection 
procedure, Crarie arid Abt's wbrR represents an attempt at.quariti tati vely ; 
rather thari subjective^ly, measuring the value of educational pro^cts. 
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In another: effort to provide guidance in the selection >5;(^.iri5trUc- 
tidhal materials, Eriminger (1970) advocated the use of- modal ity . learn- - 
itig thefiry when. selecting, developing, and TOdi1^ing(;instructidnal ma- 
terials fb^ learning di?Sbled stadents. The ayfiior noted that though 
teachers are usually familiar with^the theoreBoal positions prosed' 
for 'teaching the ^earning disabled,* hb rationale ex^^ fof; how .to- com- 
bTne educatibrial theories and ins tro^tjanal material . Cpns^^^Stly," he 
suggested that "students be evalaatea/in order to .determine, their learn^ 
ing modality s^rength$«^ahd weaknesses. .On theL basis .of -such an evalua- 
tion, instructional m|ierials should be chosen to complement students' 
abil^'ty to process irifonaatibn. ./ • . 

Tyler and Klein (1973) naaihtained that the absence of [governmental 
supervisi-on of educational prbductSi."a lacR of knowledge abodt^^'^tlje * 
fields of currtculum and ins trUctibnal* materials disagreements among 
the p^racti tioners^ in education about , the fbrmulatibn bf^guidellnes for*^* 
evaluating materiaT... and a lack of khbwledcie abbut particular fields" 
(p. 52) are all reasons why^ in the past* sb little attention jw5^ paid 
to the selectionAO^ curricular and iris trUctibnal materials. ^Aecordi^/*' 
to these authors, the recent ^ejt^hasifc eri careful . select of instruc- 
tional material is theresult of 15 yik^s >df curricular refb/nii an ih-"*^ 
creased awareness of the^eed to attend to the students' individual 
learning needs, and*a growing concern for improving teaching effective-' 

riess with aTl students. ; ' ' - 

■>■*■.■ _ . ^ 

Tyler and Klein (1973) advocated that materials be evaluatedn'n 
terms of "rationale, specifications, appropriateness , effectiveness , 
cbhditibns, practicality and dissemination" (p. 53). From these >seven 
areas the^ authors formalated 43 recormiehdations germane to the selection 
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of instructional materials; However, it was noted'that not all the 
recoffinendations .are consistently utilized by individuals responsible, 

for selecting edutational prdducts. ' " - 

_ __ i _* * . 

In his concern with the problem of selecting appropriate educa-- 

tionaV materiats^, 'Bletl (1975j;warne'd that there will continue tg be 



1? 



..onscrupulous*prodacers of educational materials/'as V^hg as there arfe 
consume^ who do not utilize sound selection procedures. Cqtlseqiiently 
he suggested that materials .can be effectively ^val^ated if /'objective . 
measurable standards" • (P^ 19)' Sre ati Ti-zfed rather than ^ubjlctive judg- 



rent.^ The'first s'tep i^Bl^iTs list of fundamental components of 

■ . _ _ ^ _ 

teaching. materials involves comparing the material to those fundamentals 

and answering the Nsic question, "80 the materials fit your needs?" (p: 

-20), This represents what Bleil called the:"look foP part af the pro- 

cedure* The second part of the process was' described as the "look out 

for". step. According to Bleil, a person selecting ins true tional ma- 

teT-ials must- "look put" for the foil owing: magic solutions, diagnostic 

labels, fad words (>r phrases, and grade-level designations. Also, Bleil 

recomne/ided that indivichjals. selecting ins tructibhal materials seek out 

'_ •' .*' ■ ' ^. * 

•the opinions of others: before deciding to purchase a given educational 
^product.' Tcr assist the consumer in deve\opitig his "own specific apprai- 

sal tQols" fp. '23]l, Ble^l proposed a- series of questions related to 

• - ■ 

.teacher needs ^ student heeds ^ and general heeds. 

./ . , ' • • • 

Bleil- also distussed\some 'of the issues related to tK^ validatibh 
of instructional rrtaterials. If the validation process has hot provided 
^i^eful information, it Is useless. Also, "different categortes of ma- 
terialn demand di fferent eval uation levels" (p. 24). Thus » in-addition 
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to looking for evidence of validatibh of student perfbrmance', the edu- 
cational consumer should also examine materials for evidence of valida- 
tion of teacher performance. 

' .... .. 

Cost effectiveness of a product (i.e., as "price per unit of re- 
sults", (Bleil, 1975, p. 25) is another feature to be considered when 
selecting instructional material: According tb Bleil, "in education, 
it is a paradox that thousands of dollars can be spent for salaries to 
invent southing which could be purchased bff the shelf for $100. OQ" 
(p: 25): ' 

Dverall, selection of instructional materials was summarized by- 
Bleil as a two-step process: "(ij ask the right questions, and (2) 
be prepared to use the answers" (p. 26). ' « ' 

Effective instruction, according to Niedermeyer arid Mdncrief (1975), 
is dependent upon the careful selection of instructional products. The ;; 
authors proposed seven questions that must be answered in order to de- 
scribe the elements of an educational products. - 

1. Does the product specify outcomes in terms of stUdeht 
behavior? 

2. I^s student progress measured frequently? 

3. Has product val 1dity been verified across settings? 

4. Are sufficient practice opportunities provided? 

5. ^ Is training provided for product users? j 

6. Does the product prbVide a means of reporting pupil 
progress tb parents? ^ * 

7., Are time and cost requirements coirriens urate with *• 
anticipated pUp.il progress? 

/ 



Ball (1976) outlined a series of criteria to be used by teachers 

-.. ---/ -i .-.---.i-i. • 

in selecting instructional materials The materials selection form - 

consisted of 50 subitems grouped within the foljowing^ six areas:' (?) 

promotes interactive qualities among students---materials are appropriate 

and well done; (BO contains pre- and post-test Ictivitiesl (c) provides; 

teacher coft^rolled mechanisms;; (d) provides Instructional support;*. (e^ 

verification a^d^val idation is apparent; (f) provides followup activities 

(pp. 209-211). Ball also recontnended 5hat, in addition to the'>reading • 

teacher, toth prof^fs^nal and Vay persons sii^uld be invol ve3 ;fn th^ 



process of selectifva appropriate supplementary reading matirials. Ampng 
the individuals identif ied'^welhe '"teachers , ■reading^cohSul tan 
cialists, students, parents, curricul uni special istSt and administrate 
and su[bervisors" (p. 288). >: - ■' 

Bolahd (1976.) outlihed^a number of steps for special edu(patibh; 
teachers to follow when ehbbsing instructional materials'. The firs*t 
step called for ah examination of the ehvirbhrriehti which was defined 
as "the kind of teacher you ace and the type of. class room- ydU have" 
(p. 156). The second step, which examined sSuderjt heeds , invblvec^ a 
series bf substeps, : i .e. , idehtificatibh of students * aps and levels 
bf perfbrnahce^ academic strengths and weaknesses^ "and learning mo-- 3* 
d^li.ties. Ih:additibn to studetit needs* teacher ►needs .step three, 
were also considered to be important". To identify teacher need*, 
Boland suggested that teaching responsibilities be determined and ana- 
lyzed along with personal teaching strengths and weaknesses. The fourth 
step in the process proposed by Bo 1%nd involved responding to general -y 
questions concerning the materials under consideration. Examples of 
this type of questions include:' , what type of material is- needed?; how 
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* long will the material be used iri the classroom?; and are replacement 
parts and pieces available? After having responded to the preceding ' 
fotir stepSi the teacher must learn what materials exist by visiting 
exhibits-bf ihstructibhal materials; studying publishers' catalogues; 
talking to materials kales >^presentatives or company consultants; ex- 
amifiihg aavertrsing in prxifessibhal journals; asking colleagues for 
recorTTmendatib;^^ attending dembhstratibhs bf ihstructibnal materials. 

Basec|4)n ih^rrriatibh gathered during the fifth step^ the teacher 
is ready S;^'lWtt^'cally to begin to examine the material under cohsider- 
atidh. Fbr eocam^ the teacher raust eocamirie whether there is any re- 
searqh' evidence to suppdrt the prdduct's effectiveness and how much 
adaptation is necessary before the material would be a useful teaching, 
resource. In this context, Boland listed 15 other questions related 
^to the physical and content characteristics bf the material to which 
the teacher should respond before making a purchase decision, - 

Watson and YanEtten (1976) developed a materials evaluation form 
designed to assist teachers of the learning disabled in selecting in- 
structional materials for their students. According ^to the authors, 
a thorough material? analysis must provide answers to the following 
questions : ■r^f'.^ . 

1. What are the characteristics of the person for whom 

' _ _ ■ * ■ 

the material was designedT^^^^^^-^^^^-^^^-v^ - 

' : 2: What is .the material like? That is, how is it organized? ' ^ 

IJhat does the learner have to do with th« materials? How 

does the learner get feedback on his performance? Hov^is 

learner perfonnance evaluated? 
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3. What is required of the teacher? and 

4. What data are available to ihdieate whether this 
program works or is worth the money? (p. 13) 

On the basis of ^ these questions the authors formulated a )laterials 
Evaluation Form by which to^udge iristructibrial materials in the fbllbw- 
ing areas: Learner Characteristi cS» Purpose bf ^ the Material, Organiza- 
tion* Format* Primary Serisbry Path Used to Transfer Ihfbrmatibh, Space 
Requirements* Time Reqlii remerits * Learner Interaction* Learner Knowledge 
of Progress* Evaluation and Data Recording Procedures^ teacher Phvblve- 
roent Required* Teacher Aids* Potpourri* Efficiency Quotient* Field Test 
Data, and Research Data (pp,. 14-17) • . 

Although Komoski (1978) did not specifically address the "how-to" 

__ _ _ _ _ _ _. • 

aspects of instructional materials selection, it was his op^inion that 
i'in choosing curriculum materials , a schooVgives literal and tangible 



form to the ciirrjcUlum decisions it has made or fias left unmade, for , 
any curriculum decisions left unmade will be made by the materials 'that 
are chosen" (p. 46). Therefore, the process of selecting educational 
products Sust yield materials that fit the teacher, the learner, and-/ 



the curriculum. According to Komoski, "the Value of an instructional 
product in a particular school curriculum is directly proportionate to ^ 
the investment ^at that school has made in the process of choosing it"'* 
(p, 48). An impprtaht reason for carefulily: selecti ng instructional 
materials is to avoid purchasing what K(*)bski described as "closet cur- 
riculum. efrahg^T" thaT"is , "classroom clfesets and school stctrerbon^ fil led 
with tangible evidence of once-tried §hd aborted eurrict^lum changes, in 
the fom of curriculun materials once fashionable but ribw unused" (p, 
48). Eonseqoehtly, KbmosRi reeoninended tftat school districts provide 
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inservice training for those individuals responsible for selecting 
curriculum materials. 

Woodbdry (1978) was primarily concerned with identifying guidelines 
fb^ regular class teachers to follow in selecting all types of educa- 
tional materials. In addition, she presented some interesting points 
ebheerning the use of instructional materials in schools. Although, as , 
pointed out by several authors , students^^jge^^^ 80-95%. of the school 
day using some form of instructional material, "there is surprisingly 
little usable research on their actual use, nor is there ^uch helpful 
theory oh the process of selection" (p. 6). Qne reason for this scar- ^ 
city of information is that the role of ihstruetibhal materials in the 
school prograift is seldom evaluated "independent of teaching strategies, 
student behavior^ and total classrobrri ehvirbnment" (p. 6). Alsb^ teacher 
use of available iristructidhal rnaterials has received limited attehtibri. 
Woodbury characterized the selection of ihstruetibhal materials as a 
cojnplete . "deci si bh inakihg prbcess/ Quiring a cr^itical mihdi a wide 
acquaintance with existing tnaterialSi aft) awareness bf trends in subject 
matter fields "and teaching methods* and an intimate knowledge b^^e's ' 
school population (both students and teact:!ers)" (p. 7). 

To facilitate' the selection of instructional, materials * Woodbury 
outlined the responsibilities that each of the^.ftffi owing groups should 
assume in the process: administrators,^.^nildia administrators, purchasing 

agents, curriculum experts, educational researchers and evaluators, par- . 

- - . . ^^^^ _ ____ ____ ' _ : 

ents, citizens, librarians and media specialists, teachers, teacher cen- 

■ •• 

ter personnel, and students. Furthermore, the author provided a list 
of questions and resources for selectibn committees to utilize in the 
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decision maRing process. A sample materials analysis form developed by 
the author was also presented; 

Teachers^ axcbrdihg to Dormant' (1979), often expedience problems 
in selefctirig i hstrtietibhal materials for their students. At first 
glancei it appears that there is an infinite number of materials from 
which to select. However, a closer inspection reveals that frequently 
there is ho material that exactly matches the needs of the student for 
whom it is being chosen. To alleviate this problem. Dormant suggested, 
that the teacher must* have a firm understanding of each student* s in- ^ 
structional needs based on ah ahalysis *'bf the learner, the subject 
matter and of the i hstructidnal envirohraeht" (p. 230), and "the kinds 
and the extent of the analyses (beihg) ajDpHjpriate to the student per- 
formance desired" (p. 231);Ve.g.i a teacher desirihg to teach the skill 
of'Shoe tyin^ can hardly be expected^ spend three months ahalyzihg 
^ student perfonnance in this area. 

To facilitate and systematize the selection process, Dormaht (1979) 

listed five phases. The first phase involves an identification of stU- 

- . _ 1^ ^ . ■ ■ * 

dents' instructional needs. The information collectecl here would re- 



sult in a compilation of attributes the material must possess. Such 
attributes might be subdivided into the following three categories: 
'^essential, adaptable and preferred attributes" (Dormant, 1979, p. 233) 

The second phase of the process involves collecting infonnation 
about the materials under consideration from *'peers, supervisors, uni- 
versity faculty, parents of the handicapped, professional conferences, 

a 

ih-service training sessions ... cdnmercial catalogues, professional 
journals ... and from information retrieval systerrK (NieSEM,, ERie)"t 
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(Dormanti 1979* p. 234). During t^he third phase of the selection pro- 
cess the identified materials are matched to learner heeds whereupbri 
they are ''submitted to the appraisal of experts, . particularly for ah. 

assessment of content accufacy ahd appropriatehess" (Ddrmaht* 1979* p. 

..... - _ _ _ _ _ . _ - . . _ _ _ _ - _ _ ^ - . 

'235). This step constitutes the fourth phase of the selectidh process. 

The fifth and final. step requires that the material be used with the 

student(s) for whom it was selected. At this point, the re fore* the 

ultimate question is, "Does the material teach what it's supposed to 

teach?"' (Dormant, 1979, p. 236). 

In Dormant's view, "the classroom teacher is engaged in a decision- 

^ 

oriented inquiry of the most pragmatic type. Trying to apply the tech- 
niques of carefully designed conclusion-oriented inquiry is not likely 
to reveal any 'truths' but is likely to cause teachers^.to abandon all 
evaluative efforts'* (p, 236). ThereSre, ,if^ expected ta 

participate actively .in the eyaTaatio^ of -cgrricular materials, the 
.evaluation .process must be classroom. specific rather than hi^ly thdtr- 
retical . : 

Komoski (1979) is one of the few authors who has addressed the re- 
lationship between successful implemehtatibh of PL 94-142 and selection 
of instructional materials in the Individual Educatibh Plan (lEP). fhUs 
he suggested that unless there is: * 
V (1) a supply of appropriate (effective^ ihstructidhal 

materials from which teachers cah select "^thdse materials " z 
which wilT best sustain the energy of learners dh relevant 
learning tasl(S(|^i arid'(2) unless teachers know how to make 



effective Use of such materials*, the PL 94-142 qtiandate re- 



quiring teachers to design and implement an "individUcrl 
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education plan" (lEP) for eaeh Ha^lcajDjDe learner in hiS : ' 
or her Glassrooni is unlikely tiS be met. (p._188) / 
komoski also reported some startling dall cSncernihg teacher par- 
ticipation in the selection of educational materials. Results of a sur- 
vey of 12,000 teachers conllucted by the Educational Prbduets Information 

Exchange revealed that: (a) 45 percent of the individuals surveyed in-* 

■ .1 

dicated that. they do not S|lect-the instructional materials that are 
most used in their classroomg; (b)^ the remaining 55 percent (those who 

do participate in the selection process) indicated that they spend ajD- 

_._ ■ ■ _ ^ 

proximately one hour annually to accomplish |his task, and (c) less • 

than half of the same 55 percent reported that they had received train- 

■ ■■ • . - ■ • 

ing in how to effectively use the materials that were selected. , 

9n the Basis of these findings, komoski noted that regular class- 

room teachers are in^an unlikely position to select materials designed 

to meet students* educational needs. Furthermore, koma^ki questioned 

the ability of regular classroom teachers who are responsible for de- 



veloping individual education plans to do sS effectively given their 
apparent lack of training in how to select instructional materials, 
the limited ambUnt of time they spend selectir^g such materials, and, 
in many cases, their lack of tnvblverrieht in the selection process. 

Based on interviews^ the author concl udec^ that the above-mentionetl 
shortcomings related to materials selection Were more representative of 
the practices of regular teachers than special education teachers. Far 
although tl>e special education teacher "rarely has had any more training 
in the selection and Use ^f instructional materials tHah the regular 
classrodffT^t^adh of Jthe handicapped tends tb^ive much 

more attention to, 'and 1s much more concerned abqut^ the effectiveness' . 
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and appropriateness of a specific instructional material • than is the 



' .^;:?^o\ar c1^^^ teacher" (Komoski , 1!979, p, 192). 

,v . : of F>L 94-142, howeVer, wil 1 not. occur ♦ 

. rers^ly as a r|^uj^^ providing teachers -with time for and training in 
' • ;the sejectlph^of nnst^^^ materials for the handicapped. Rather, - 

; change niast take^l^ce "STOfiq thosfe;who develop and market instructional 
matenals ^and^n^n^ eiT:ab1ish &ie_pqlities that govern the 

adoption, selection,, arid purchase: of instructional material" (p. 194), 
For, '^s Komoski stated: \, ; : • 

if Pt 94-142 isrtruly en^^rced, hot^only will classroom ^ ^ 
teachers find theraseVves in need of the skills and tech- 



niques that will enable them to build' 'individual eduea- 
.tibn plans', but they will also heed raatedcials that have 

. \^ - -1 . ' J. ■ ' :^ , . _ 

been ajDprbpriately 'Jievelbped and screened which will help 
them to turn those" plans into a heal ity^^ handicapped 
learneV. "(p. 195) ' ; . . . \ ^ 

BecauseWducators. suffer frdm 1|k:J; of time for arid training in* 
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selection of instructional products^flley seldom, know what to look for 
when examining such products! Consequently, teachers "continue to be 

influenced by th.e instructional ly less essential charscteri sties of 

: . ■._ v./ v , .v ■ ^ • ' 

^material such as packaging, prestige x>f 'author or develapefi and, of 

course,-the new aflproach t6' the content" (Kbmoski, 1979, p. '202). Tp ; 

avoid falling for -such feature!, teachers should ask "the bbttorrFline- 

of-Tearning question"; "wil.y this material help a teacher (either my- 

i . i::. 4 _ _ ; . . 

self or the person I'm selecting this for) to change a learner's behavior 

JDOre effectively, mor§ efficiently, or more humanely than the material 

rS now flsing?" CKoinoskl,- ^1979, pp. 202-203). . . 
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the relationship between teaching ari?l ihstruetibhat materials was* : 
described by Cohen, Alberto* arid froutman 0979) as -inseparable in th^ 
the i ristructidrial materials tie together th^ currictjlUmi teachirig methods^ 
^nd students learrii rig achievejnerits. To assist, teachers iri inakirig worth- 
while selection decisidhSi Cdheri et at. recbrmierided tHe use of ari iHquiry 
jnodel coritairiirig the folldwirig four questibns--whOi why* what*, arid hbw-- 
whereby the individual respbhstBle for seledtirig iriStrUctiorial materials 
should be able to determine the ifjstructidrial wdrth df^the materials' 
under consideration. - 

Each question relates directly to the fdllpw1n§ pedagogic * 
concepts: (1). Who-*- refers, to the target papulation; (2) 
Why-'fefers to the purpose of the material ; fS) What-^re- 
?ers to the structure, format, methordology, construction, 
jfunction, and .quality; arid (4) How--refers to process, 
management, feedback, respqnse models), generalization, . 



adaptation, • and sequencing, (p. 7) 

Schwartz {1979) found that teachers of haridi capped high-school stu- 
dents experienced even more difficul ty finding suitable instructional 
materials for their students thari did teachers otf elementary-^age stu- 
dents. Materials for hi^h-sehbol stufevts must not only be designed 
to jneet their academic needs, they must^aUp be iri keeping with their , 
level bf sbcial maturity'. Finallyi this group of students muist be pro- 
vided with materials that look like those used iri the regular school ^prb-^ 
gram. - _ : 

To achieve these goals Schwartz advbcated deal i rig drily With estab- 
It^hed arid reputable publishers arid purchasirig materials for which field- 
test^data are available. Schwartz further suggested' that teachets coriduct 
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a "slipgrficyj evaluatibri" of materials uMer ebrisideratibri for pbrchasei 
that is* the material is examined in order to determine "bbvious'' char- 
acteristics like the publishing company^ authbr br designer of the ma- 
terials and the date of publ icatiofl"- (p. 20). During this evaluation 
' phase > the teacher should also examine the format and content of the ^ . 
material and decide whether or not the material appears to match his/her 
own teaching style. Product durability and ease of storing should alsb 
be conside);id before the material , is subjected to a "more iri-depth con- 

tent examination" (Schwar:tz, 1979* p. 20) covering the central theme 

^_ i__ _ _ < 

of the material and such; considerations as whether or not the material 

will fit the number of students whojwill be using it, quality and rele- 

/ vance of photographs and illustrations including racial and sexual bal- 

\j ance. The fin^il consideration .in the selection process deals with the 

adaptability of the ma^rial. Adaptability here refers to i^e '^variety 

. »of:ways material can be adjusted for classroom situations" (p. 21). 

Hasazi's (1979) guidelines for selecting instructional materials 

^consisted of nine questions to which, the potential purchaser/ developer ^ 

of instructional products should respond before buying or creating a 

new iriate rial : ' . 

1. Does the ihstruetibhetl program describe its. a.ims or 

goals? _ j^- 

2. Does the ins true tiohal program describe the enabling 
skills br prerequisite steps requi^d to reach the 

final gbal? • . ^ 

3. Are there provisibns made fbr assessing a child's 
entry level bn the enabling skills and final gSals? 
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4. Does thf ihstructidhal program reqtii re: frequent stadent 
responding? 

5. Are there provisions for delivering feedbaeR^liW ebrrect 
responses and'speciffc strategies for correcting errors? 

6. Does the instructional prdgram provide a measurement system 
that contains periodic check points arid provisions for; mov- 
ing a child ahead, or reprdgrarnmirig for skills riot learned? 

7. Does the instructional program allow for resporisesvto be 
made in a variety of wa^s in order to' demonstrate .^earriing? 

. 8. Does the instructional program suggest strategies for en- 
suring that the 'ski lis learned can be' utilized across a 
variety of learning environments? 
9- Does the instructional program appear interesting 
functional? (pp, 32-33) 
_ Bbrderi (1979) presented a model "for materials analysis involving 
the use of a grid system on which ratings of instructional materials 
could be recorded. In this connection the author *also proposed a nunF 
ber of evaluatiori criteria which could be used for instructional ma- 
terials arialysis. The criteria were grouped, according to the following 
five areas: (a) Objectives; (b) Skill requirements arid sequence; (c) 
Instructional techriiques arid requiremerits; (d) ' Moti vatioriil factors; 
and (e) EvalUatiXDri. While Bbrderi rioted that the above criteria were 
suitable for his use^ he suggested that other evaluatprs might identify 
and use other evaluation criteria. ^ : 

Wilson (J978) described the iri^tructibrial materials selection pro- 

_ _ . _____ _ * 

cess irt terms of a ''curriculaj;::-student- teacher triad" (p. 374), fhai is 



each aspect of the tria^ih some way ihfluehees the other twb; In order 
to make a wise seiectidri* the teacher must examine curridulari student; 
and teacher^variables. Wilson noted that while it is hot ynebmmen- for 
teachers to carefully attend to the curricular and student variables 
they frequently>fiverldok the teacher variable. Since "it; is the teacher 
who must act as the catalyst to assure ihteractibh ambng-^e bther two 
components. . .hi s/.tler desi res ^ knowledge^ and cbmpe tehee must be con-' 
sidered" (Wilson, 1978* p. 376). Specifically ^ Wilsbh suggested that ' 
meiterials under consideration be examined on the basis of (a}\bibltpr; ' 

graphicinfomiation, (b) price* fcj instructional area*, (d) skills scope . 

_ _ _ _ _ _ _ '__ _ _ 

and sequence, (e) component parts, instructional JeveJ* equality* format* 

av'ail able support materials, time requirements, fi el / testJRtth research 
data,, and methodological approach, and theoretical bases (p. 381). Since 
the above criteria are not inclusive, an individual responsible for se- 
lecting instructional materials may" wish to add others or, expand and 

: , _.t 

adapt those presented. ' 

'A'l though Bender and Baker (1979) were primarily concerned with pro- 

^ _ ^ _____ ^ ■___J^^___ __ • 

vidihg guidelines for the selection of social studies materials, their. 

proposed selection criteria are applicable to anyone respons**ble- for 

reviewing and selecting instructional products. According :to these 

authbrs the following elements must be' included in the selection process: 

1. Many persons should Be involved in the process: the 
professional teaching staff, (^hildrg^building admini- 
stratbKs', and even, in some instances, parehts^"' 

2. Statements of criteria, for seleetibn bf materials must 
be explicit. These should be developed eboperati vely by 
thbse mbst cbncerned with and irtvblved in the seleetibn 



of these materials. These .statements of criteria must 
not be based on assumption or thoughtless expectatidhs . 

3. Empirical Information about sources- for media must be f 

^ _ _ _ ______ . ' _ 

expanded and critical annotations of resources and col^ 

lections must be available and used. > 

4. More kinds Of Informat^ioh must be used* Including pro- 
fesslonal analysis and user reports. ^ Evidence of effective- 
ness, learner, verificartion, and instructional validity is 
required to support this process. X 

.. 5. Excellent techniques for examination and ^review must be 
iyentified, quantified, and refined through use. Compre- 
■■ -~ hensive checklists, rating scales, and other hard evidence 

must provide the criteria of acceptability. Unstructured, 
subjective cornnent^ will not -do. 
6. Objective evaluation of materials must be increased. 
Systematic evaluation and verificajtion of materials 
^hrpugh use must prevail. Qpihion and impressions will 
not do. (Bender & Baker, 1979, pi 353) . 
In surnnary, the guidelines called for prospective users to exam>ne 
materials under ebnsideratioh in light of the follewirig eight areas: 
purpose, producer, Authenticity, appropriateness, content, supporting 
bpinibn; supplementary informatibn, and validity. 

The purpose of the previous section bf this review was to describe 

■ ' - "J ' 

existing approaches to the selection of instructibhal materials. Latham 
(1974) summarized the state of the art af materials selectibh in the ^ 
following manner: "everybne is talking about it* nearly everyone is 

.... : ' ' : ■:, 
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doing sbmethihg about it. but no one seems to be getting very far atMt" 
(p. II). hatham's appraisal of the situation nine years was a fairly 
accurate one. and unfortunately, it has not improved since then. Guide- 
lines prbpbsed^for materials selectioh have not changed appreciably over 
the last 15 years. While this phenomenon may be viiiwed as evidcRcg that 
the criteria identified thus far are- appropriate, no research has been 
* conducted to verify this notion, furthermore, no research stydieS have 

examined whether or not those ihdividaals who select Instructional ma- ' 

... , ^ . 

terials util ize systematfc procedures to accomplish this important task. 

While much has been written about the need Ton'systeStic selection 
_ \ __ _ _ ' l . ^ . ■ 2/ . , \ 

practices* virtually no literature is available. on which criteria, ff 

any, are currently decerned important by those responsible for selecting 

instructional materials- further research in thf^ area, therefore, 

should be directed at identifying existing materials Selection practices 

rather than describing wtiat ought to beeor. Without such information, 

iTnprovements in materials selectib^n prcteedures ang unl i Rely ^-tb be im- - 

plemented. ' . C ^ 

Eval uation of Inst'ructibhal Materials 



1^ It is difficult to discuss the literature on iristructibhal materials 
selection practices without also describing the materiaU evaluation lit- 
erature. In fact, the terms eval uation and selection have often been 
used iviterchangeably. The remainder of this review ikj devoted tb the 
literature on evaluation of instructional materials. 



, An ^educatiofial review was defined by Scher|)er (1975) as "Ah activity 
carfied out by an organization that must choose one Or several educatibhal 
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products froni many, pds'slbnitlp" (p- .1).- ^Schemer differentiated be- 
tween an educattdnal review" and an evSTuatibh seating that "in a review, 
very little tim is spent rating each iDrodUct^ usually a matter.of hoftrs'' 
(p. 1). The author made a further distihctipri between an educational re- ^ 
view and an evaluation saying that "ari evaluation'-eolleets data abotit a^ 
product or products, while a review uses whatever dat^ and infonnatiOn 
are available in order to make a decis^Ton ajpbng produets" (p. 1), While, 
in some instances, evaluation is carried but as part bf the review pro- - 
/ess, the review process, according to Schentleri must be approached in 
ah equally, ^stefnatic and logical manner as is a product evaluation . 
The author identified and defined three* categories of ihstructibnal ma-, 
terial wR^ch may be the subjert of a review, i.e.* products^ programs^ 
^nd practices. ; 

Reviewvniay be divided'into two categories: single or mixed topic, 

_ _ 

A single review is used to decide among products with the same^ pr similar 



-stfc jee t-ma t ter^i -whe reas mixed to pic review re fe rs to a sf^l^c t4en-pro€Wiirg---— 
* - ' ' , * '■ ■ , ■ - • ■.>■ 

used to choose among products representing a wide variety of subject mat-^* 

ter. Sehemer identified six kinds of decisions ^or which reviews may 
be used: (^) to develop a product; (b) to, continue development;' (c) to 
disseminate a product; (d) to package a program; (e) to recoimiend a.pro-.-r*; 
duct; arid (f^to use a product. The last type of decision is the one' 
for which tlpachprs^ schools, and sehoSJ' boards w^uld utilize tfie r'eview 
procedure. - Iri sucK a review the criterion of approlwciateness is of most 
importarice because the iristruetional prodt^et is being chosen for a par- 
* ticular student, school- building, or school district. 

Evidence bf product effectiveness is ari aspect of the review pro- 
cess that it dfteri bveflbbked by reviewers; In Scherroer's opinion, the ** 
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best prbducts cire not necessarily those demonstrating the, greatest evi- 
dence of effectiveness. Rather*, "the products with the best evidence 
• i.will tend to be the ones whose goals are the niost straightforward 
and easyto measure, and the ones that are used in situations where ^ 
controls are easy ta institute'' (p. 13), Thus, reviewers who include 
evidence of product effectiveness iri the- review procedure must be' aware 
of the possibility of bias against those products whose goats are not\, 
straightforward and easy to measure. ' - 

Schermer divided the cri teria^-u^ed^i n reviews into the fc^} lowing 
fivfe- categories ; \ _ ' J- 

1. the effectiveness of the product; 

2. the heed for the productj 

3. the intrinsic quality; ' * 

4. the practicality; and - \ 

5. the qUal i ty of supporti hg evidence, (p. 14) ^ • 

\ Unless review criteria Used as a product screening measUra are 
scaled^ the reviewer has hd notion of the extent to ^Whtch. each criterion 
has been met. ^ y 

Schermer suggested that review criteria be viewed as "a checklist 



6f things to consider" (p:. 55), and stated that 4^5^p5 r^yiew criteria 
in this manner is : ' /^-^H ^ . * 
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probably' more important than trying to use cri'ter^ to get 

--- -1 - . -■ - - - '-'h 

a set of numerical ratings whidh, when averaged with appro- 

priate weightings, will give' an overall racing* Perhaps a ^ 

________ _ ^.■__ -__ __ _ _ 

set of criteria which can be used in thiV way for all products ^ 

will some day be developed, but w^r^pv^ found no sign of it 



, A model rating fdnti originally designed for use in hatibriai-Tevel 
; reviews was presented along with suggestidris for mddifyihg it to make 
It applicable in a variety of review situations. 

Browia ( 1975^ proposed, a mgthbd^fdr analyzing instructional material 
, and curriculum programs whi GH.4.ihyd1 Ved use df a Q. sheet consisting of 31 
questions. A Q sheet "is a generic --tenTi whiC: refers tg^Hy standard ^^^s^^^ 
of questions, probes or program eT^ments to be used a$ basis for 
systematic analysis, in this case, cdmporients 2)f 'an instrUctidnal pro- 
gram" (p, 4ll). Brown- out] inecl a. 'number of situations in which a syste- 
matic analysis of instructional materials would "be useful for the educa- 
tional practitioner, i.'e^ , (a) to examine the ^internal consistency of . 
coimercially available programs; (bj to compare fhe quality of two or 
more instructional materials prior to purchase; (c) to determine if a^ 
student is experiencing difficulty because he is using the wrong in- 
structional materials; (dj to develop a curricular history of a student^ 
or a group of students in order to identify those programs or materials 
with which they have experienced either success or difficulty; (e5 to y 

' , - - . s •■■■>- , ^ 

assist in i-dehtifyihg appropriate supplemental materials for a student; 
(f) to help in systematically idehti fyihg the strong: and weak eompdnents 
df a given i ristructidh^l program^ (g) to aid the praetitfoher in develop- 
ing a systematic approach to materials adaptation; (h) to promote cur- 
ricular research by prdviding the researcher with a means df systematical 
ly cdmparihg dr manipulating materials variables^ (i )_ td make* supervisdrs 
and consul tahts appear less threatening when thiy cdmmeht dn the apprd- 
priateness of materials used in an educational program; (j) td; assist 
the practitioner in determining the simil ari ties : ^nd differences in new 



. materials ; (kj to increase professional cbmpe tehee in the area of ma- 
' teHals speeifically^designed f€>r,:tise''w1 th special educatibrt. students ; 
WiederhbVt and HcNtitt' (1977) described some of^sthe difficulties 
teachers experience in attempting to evaluate the appropriateness of 
instrUctidrial materials for handicapped adolescents, Gurrently avail- 
able •seleQt>d^^ 5^ designed to assist the teacher who 

Is Iddking for suitable materials for 'elementary-aged students, thus 
few* if any* qu^^^^wes Ixir selecting itis true tibri materials are Avail- 
able for older handicapped students, 
- > , - - 

The authdrs proposed a twd-phase approach to cbmjDrehensive eval- 
uation- of ijis tructidnal materials for handicapped addlescents. The 
first phase* static evaluatidn* dccurs when a teacher decides updn the 
instructidnal materials or program td be purchased and implemented-. 
Dynanilc evaluation, on the other hand, takes place after the student^ 



has used a particular material' or program for a period of time. The 



purpose of this evaluation phase is to assist the teacher in determin- 

f _: _ _ ^: : 

ing whether or not the material appears to meet student needs and hence 



whether the program ought to be modified or discontinued'. The authc 



described five elements to be consi dei^mghen performing a status/ma- 
terials evaluation; '*(!) relevance of the material to students* heeds; 
(2) readability levels of the prihted materials; (3) lahguage of the 
materials; (4) prerequisi tes<; ahd (5) motivation" (p; 13);- s 

'To conduct a dyhami'c^val uatioh of ihstructiohal materials the 
following four teehhiques were suggested: *'(1) pre/post testihg; (2) 
a>^lytic teaching; (3) bbservatibn; and (4) interviewing" 15). Each 
techhique requires that the teacher carefully and systematically examine 
the student's ihteractibh with the material being evalauted and decide 
if it meets the student's i hstructibhal needs. 
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As mentioned previously, no consensus has been. reached cohcernitig ' 
what Is meant by the term eval uation . Ward (1968) maintained that "when 
a teacher^decides tb use or hot use ah available material^ ah evaluation 
is beiitg made"' (p, which.^ in turn, was considered to be the starting 
point ffOTT which teachers might begin to practice more stringent eval- 
OTttcft procedures. * 

(1979) described evaluation in far more global terms. In 




every t>me corporate deeisioh-maRers in ah educational 
*l»t€rrials company decide tb develop or not tb develbf), 
ta* irarket or hot tb market, tb revise or hot tb revise 
ipar-ticiilar i hstructibhal materi al ^ -that material has 

iseeh evalUat^. And every time an editorial director 

r " 

iStides to shape a material one way rather than another, 
ttet materiaT has been evaluated. Similarly, every time 

i cdrnpahy sales representative decides to recommend or 

' ■ %' ' 

J»t to recommend 6 particular material /to 'a prospective r 

. - V . j 

ll^rchaser, that material has been evaluated,. In addition, ' 



> i*ry time USOE, NIE, or any other. public or private fufid- 
-iiig agency decides to fund the dissemination of orj: mafeH^I^^ 

tifd not other materials, those materials .^ave been evaluated, 

A ^ ' __:_L_._^._..__V.. .'. 

t[ ifkesise, every time a teacher chooses a material for class- 

y -"Vim use frm such a list, or from a publisher's catalog, 

.TT at a coiT^Tiercial exhibit, that material has beer) evaluated. 

difcewise, every time that teacher uses a material for a spe-^ 

r'/ic purpfee or decides. not tq^use it agaih^ ttiat material 



been evaluated.; Finally-i although hardly eyer recbgnized 
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for. that is is* every time a learner uses a particular in- 
sti^uctidnaV rhateHal iri:a jDurposeful way or fails to so use 
it, t^bat material, is uridergoirig ah evaluation' that is far*'' 
more important than those ^valuations it has undergone pripr' 
- to that moment. For it is only at this tiibment of instructiori, 
this ultimate bottom line as it were* that it becomes possible - 
to come. to something approaching a valid decision as to the 
effective i nstructidhal value of a particular instructional 
material. (pp. 197^198^ 

Moss (1968) described an evaluatidn procedure which relied on 
teacher evaluations of materials use in classrdbms as bging the most ^ 
likely to yield valid information about instructidnal materials, to 
compensate for such probleins as overalffi cos t, time factors and various 
other impractical i ties inherent in an evaluation system that utilizes 
only te^acher input, the author proposedP'a system consisting of "five 
levels 6f evaTuatioh input. Briefly, th^ first level of input comes 
instruct! opTa1 materials center ( IMC)^*i^ary, staff who woul^. ana- 
the physical charatcteristics of the mati^ial. The Second level of 

the evaluatidn scheme would require the same libl^ary staff to work with . 

. — ' - /- 

other IMC personnel or consultants in preparing an analysis of the con- 
tent df the material, behavioral objectives j task analyses, and rationale. 
Teacher input arid iriforrriatidri obtained from classroom observations would 



constitute the third level desigried to yield information relative tothe' 
effectiveness df materials iri classroom situa-^idris . f^search studies, 
the fourth' evaluatidri levels wduld prdvide '^findings Sri learning var- 
iables and_^ffects; teacher reactidris; iristructidrial variables; and 
effects of innovations in use df material* etc." (Mdss, 1968^ p. 305). 
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Finally, the rnstrUctibhal .raaten'als i ndds try (i ;e. , publishers, pro- 
ducers ,o^,Jtiaterials , ajid authors) were identified by Moss at the fifth 
source of evaluation input responsible for providing a rationale and a 
description of 'the population for whom a given material was developad. ' 
According to Moss,, the ihstrUctibhal materials producers might also be 
responsible for supplying some of the information Obtained from the 
other four input levels. ^ , ; : 

Mclrttyre and Nelson (1969) proposed a, two-step. approach to the • 
evaluation of instructional materials, immediate evaluation of ma- • 
teri^ls would lensue from having Ijtpert panel members complete ihstruc- 
tioffal material checklists. These Checklists wOuld provide informationj 

aboiit "some aspects of the internal qualities Of material, such as dur- 

' . ■ V 

ability, convenience in storage, probable attractibri to children, etc.". 

(p. 25). The expert* panel rembers would then- be^sked to determine how 
well the material fit a given program's sco^*and sequence, a^d, to in- 
dicate if a particular material was in keeping wfth thp> educational 

- - ■ - - _ _ [ _^ _ ^ - 

objectives of the special school orvc-lass. ' 

While Melhtj^e and Nelson (1969) considered this type of evaluatKin 

^ intrinsically useful, j^ey suggested^ that, ide*Sly, instructional ma-. 

terials must be evaluated tf^tieih an empip'car framewHI. including: 

1. A statement of the edoca-tiohal objectives whixh might 
be achieved 'through use of the item. 

2. A sp^ificatibn of the range ^nd typ^ ef. children or 
youth to be instructed with the item. ' ♦ 

3. A descriptibn bf the degree of" teacher jnvolv^ment 
and/or. coinpeteiicies required, (p. '2p) ' ' - - 
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In addi tioJi,.' th'e atith examining a material 's prob- ' 

ability success-- th esijmatihg whether br^hbt certain edaca- 

tT^h^l'Voals will be re.athe^d given thV-iyp^ of ^tudents and caliber of 
teachers who will use the ma ten al onder^^eajsideration. Furthermore, 

it was .suggested thar^auiiaieYial be evaluated in terms of its educa- 

- _ — -^i-. ' - - . _ - ■ 

tional efficiency^ that is^ an evalua*^ must IboR at a material in , 
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, terms of the .time, arid effort f^jquiM to accomplish educational goals. 

Finally^ th^auth^ns .b|jttTried the steps necessary to implement a 
model for^ field-based, e analyze instructional ma- 

»^i^ta^s along^he follbwi^^^^ (a) practical aspects bf 

the material (f'ffe. , ease af use^ convEni^Ces space r^uiremeritSi etc.); 



"^b^'amaunt of teacher invbls^enie^^t reqm to achieve maximum educar 

■ "l * . . . ^- :Ti-%v^V>'^: - 

tional ''beTieftts ; (c) durapiVlttyl;%fl^;{d) evidence that the material was 
* responsible for the attainment of changes in pupil behavior/ '3 
ilclntyr^ (1970) d^eri<&&d Evaluation as "the basis for deci-sfon * 
making, and as such, [it] includes both^ description and judgement, ahd 
V . 'colleGtibn of pertinent ^ata on which to base judgementslV { p. 213). 
y ^ Aecording^' to Mclntyre, ^evaluatian and resear^ are not synonymous terms. 
, ' In Research, validity measures should be ej<terhal rather than internal ; 
as» bpppsed to evaluation which is not: as concerned with other popula- 
tions and settings (generalization), and Hence uses internal validity 
measures. ^ *■ . ■ ' /■ 

Hclrityre identified the fbi^lbwipp fojtir' ap^baeheis to >ns true •Clonal 

materials evaluatibri: (a) u^ilizatibn bf expert judgment; ' (b) c^^ti^n 

— , ' '. - - - * i i - - ^, \ - - - - - — 

bf a panel bf. experts tb wbrk. through ah S^IMC; (c) Utilization bf mas- 

. " . . - - - / , ^_ ..... 

ter teachers in the field who would b| paid for their services; arid (d) 



having teachers iri the field ev^aluate tnateriajs borrowed from an SEIMC. 
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The author emphasi2|d that |He type of- ajDprbach selected is dt- 
pendent uppf^»^^^e heeds , objectives, and resources of the individuals 
who perfarm the evaluation. Above all^ thr materials evaluation jpro- 
cess must be "ori-goihg^ ebritinuirig. . .and iriteracti hg. . .the data gener- 
ated are used to modify the system}^ to- make deqisiohs, to maRe the in- 
structidhal system self cprrectrhgi and only data which can-be used are 

collected^' (p-., 219). - • f'" . - ' • v 

V- ----- - - _ _ ; 

Eash (l969) designed an evaluation instrumerit to assist in the 

I" 

selection of instructional material s , based on the hdtidn that such ah 



1 nstrumenx must be capable of pinpointing in'structiohal products that 

• _ . ■■. ..^ . ■ 

can tie effectively i^cof ppra ted into: the j^ghool prdgrkm." Thus * the 
resultant ins trumen,t Was intended for dse in the selection of a variety 
of instniictionay products • 

... ; / 

Four x:onstructs - objectives .^organization of the niaterial (scope 
and sequence), methodology, and eva! uation - - formed the%asis of the 
instrument. Included in evaluation forp^were provisiqns for a "sum- 
niary qjaapti t^i ve judgni^t,-,^ ov.e?a1r judgment of the^ niaterial s as a 
learning package, ... an¥*iu6s tiohs 'i^hiGji ^el i ci t i dh develop- 




ment and, eval uation procedures usedf^^the prodtfcer ih creating the 

learning pafckage" (p.. 1). ■ V/^^'* 

The proposed evaluation pr^iSfi^^ei r^^^ traihihg of those who 

Wotild eventually use the eval uatiafi n'ns^pmient tO' ensure maximum utili- 
^ ( zaijon. The fQllowing training butebmes Qfeserve parti^bul ar attentibh . 
^ When teachers ware trained; to systematically examine material s*. they 

also became more iaware bf the^ intended use of 'those m^^erials and, con- 

_ - ^v' - ----- - - - H.^''' ' - -s' - - ' 

seqUently, were more likel^ to use tl^m , for* me intended- purpose. As * 
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Eash noted, failure to attend to the intended use of ihstructibrial ma- 
^ ^terials^ll^bften a major reason why certain materials fail to meet user 
' exjD.ec tat ions ; As a result of systematically examining iristructibhal 
materials, teachers '^becar^ aware that "scarcely any instructional ma- 
terial is a^ sel f-contained learning package for a range of learners'- 
(p. 2). Such an awareness causes teachers to attend more carefully to 
; matching materials and students' edupational needs. Furthermore^ it 
was found that evaluations performed by two- to three-member teams re- 
sulted in more effective assessments of the materials than did evalua- 
. t ions performed, by individuals. - - 

The evaluation^of instructional materials was defined by Levine 
- (1959) as a "tool for providing ♦today *s teacher with a means of getting 
into the jungle (of instruetiohal-materials) ; finding particular ma- 
tfHals.tb meet her heeds; and bringing them into the classroom and 
making effective use bf them" (pi 1), tevine noted' that while a range 
of procedures have been identified to assist the teacher in evaluating 
instructional jTiaterftl|« 1 i ttle '^iderice has been found to.support the* 
notion that one approach is better than another. 
^ In an effort to remedy this situatibh* Levine conducted an Evalua*- 

tidn Institute aimed at creating a library bf material evaluations^ ' 

> ^ - - - - ( 'i-.:^ :f • ^ 

.whil&Aat the same time systematically studying the evaTuatibh praees^. 
) Sixteen teachers of, jbhe educable mentally r^tir^-^iier^.H'rr^^^ 
; ..ticTpate. in 4he Institute. • * * V"* - . ' * 

; : Through the Insti tute?^the author hoped to; de%rmine: (a) if difr 
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•-' . ; .f»renf types o^-^ materials require- Ihfi use bf diffefent evaluative cni- 

- _ ^ • . - . ^- ■ ■ - >- ^ 

v^V;. terjeP.; (b) what criteria are. identified by the practitioner as impor- - 
tant; (c) and wfiether;'oi^ riS't. it is possible, through the use of a g§m 

. • ■■ ^ M--' : ■ ' ' r 
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format, to make teachers aware of the Variety of questibris that must be 
■ asked when evaluating instructional materials. In th'^ course of the. 

._ __ __ .__ ♦ 

institute, the following, criteria were most frequently identified: : 
"cost of the material, whether it can be used Individualiy or in groups, 
the type of child it can be used with, and whether it contains student 
appeal'' (Levi ne, 1969, p. 6). ^ Also, it"^ found that the criteria de- 
veloped by Institute participants for instructional hardware arid soft-* 
>/are did not di'ffer. * ^ 

After establishing a set of evaluation criteria, participants were 

- /-^ - 

requested to develop an e^^luation form and later apply it to a number 
of Materials. At this time, part^i cipants were given an opportunity to 
^Iter tfie Evaluation Form. However, only.mindr changes were made. 

^ _; ___ '. ' 

The main problem with this approach .to evaluation was the artificial 
; eriviyx)rirtjerit in which the eval uations were performed. Based on the con- ^ 
victibri that a more accurate evaluation couVd be gbtained 'if materials 
.used in the classroom were irfeluded iri the study, an ongoing evaluation 
grdup--the Evaluatibh Netwbrfc of Indiana Teachers—was established. As 
a result of Netwbrk JTieetirigs concerning the usefulness of the Evaluation 
Form in attual classrbbm settings, it was determined that the checklist 
foy^mat was riot, inclusive enough. Thus, blai# spaces were recommended^ 
for the recdrdirig of pertinent iriformatibri rather thafi a checklist for- 
mat. ^ased dri^the results df the- EvalUatibri Institute, the author eot»- 
eluded that K was, iri fact^ pds^sible td:de^elbp a practi tibner-eeritered 
approach to the evaluatidn of iri'structidrial materials withbut ustrig highly 
sophisticated evaluation instrumerits. If teachers ar^ td serve^ as active 
participants in the evaluation process, they must serve "as the dgveldper 
of evaluative criteria, as the evaluator of the material, as the develdper 
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of a_ vehicle fot" di§semihatibh, and as the reader of the completed, eval- ' 
uatibn" (Levinea ,1969, p.H)^- 

Baum (1972) reported the perceptions of teachers of the mentally 
retarded cbheerhing -^eir abil ity to evaluate instructional, materials , 
their willihgriess to par9icipate in the Evaluation process, and their 

judgment of the ability of others to Evaluate classroom materials. Ah 

• -- - - - ----- ■-- f ; ' 

11-1 tern Lnstructibnal Materials Evaluatibh Scale was mailed to 199 teach- 
ers selected from the membership files bf the Kansas Special Education 
Instructional Materials Center (SEIHC) Apprbximately 85% bf the re- 
spondents (92% of the m^ntiership) indicated that they did not feel that 
teachers lack the skills necessary to evaluate iristructibnal materials. 
I Over 95% of the survey respondents stated that other teachers' evalua- 
tions of instructional ma^terials were of interest to thei^* and nearly 
84% expressed an interest in using evaluations completed by other bdr- 
^rowers of SEIMC materials. Nearly 84% of the respondents agreed that 
teac(ier evaluations of materials were of nsDr^ use to them than publisj^ers' 
claims. Further, survey resul ts^ overwhelmingly indicated (nearly 9p%) 

. _L _1 __ 

that teachers do not agree that principals are better evaluators of ma~ 
terials than teac^ersl Slightly fewer --feachers (82%) disagreed with the 

' lL ' [ . 

statement that school psychologis^ts are better evaluators of instructional 
materials than teachers. 

in terms of wil 1 i ngness to participate in the evaluation process, 
the responses of th^ groUp surveyed were fairly evenly divided as to ' 
whether or not teachers have the time to evaluate instructional products; 
However, over 81 percent of the respondents expres&ed ah interest i^h using 
evaluatibhs prepared by bther teachers. , : • 
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brt the basis of survey results BaUrti i^cdnfi^hded tKat "the Regional 
Center arid its affiliates must take the initiative in ericburagirig teach- 
ers to participati iri the materials evalu%tibri process arid in demonstrat- 
ing its value; to teachers" (p. 50). to ttlis "erid^ Baum recbnimerided that 
SEIMC's provide preservic^ and ihserviH:e trairiirig to enable teachers tb 
^ systematically evaluate 1ns|;ructiorial products designed fcr Use with the 
retarded. " > . ■ . 

McLaughlin and Trlica* (.1976) 'Advocated thkt teachers be included 
jn the proces? of evaluating instructional materials. Their review of- 
the^ literature offe^l f|jr/t,her support for the need for teacher involve- 
ment and input^in the evaluation process. The authors suggested that 
rafter a given material has been used in the classroom, it should be 
evaluated by jneans of ^'a* structured checklist that is easy to read and ; 
mark,, no longer than one page, and that^requi res from 10-12 'minutes to 
' complete. , The form dev^eloped by Mctaughli^ and Triica focused on the . . 
eyalaatibn of the follbwing areas: "curri cu1um emphasi's", content, ap- 
propriateness, instructiohs, physicqil characteri'sti cs r and general in- 
fonnatron" (p. 54) . , 

Fetter (1978) developed ari instrument des'^gned to assist in eval- . 
] uatiqg a^va^ie.ty bf instrejctional materials, ' The: i ns trument consisted 
,bf items' to be checked aad a series of questions about instructional 
materials to which ah evaluatpr v^as to respond by either cheeking "yes" 
or "no". 

- ^v-' ----- ■ - - • • 

Iristructibrial materials, according tb Fetter, riiust -be examined tb 
det^rmirie whether br ribt they serve as an aid iri the learriirig process. 
Iri this coritext, Fettpr cbrisi derc^d' eval Uators rosporisi ble for alertirig 
niaterteTs producGrs to the fact tliat'edLRzatiOrial corisumers are Iriter^sted 
only iWi those products that provide eviderice of their effectiveness. 

i 5 f • 
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While much has been written concerni ng th^ selection and evaluatibh 
of instractional materials,^ need still exists for indepth research in 
this area. As' evidenced in this review,i.eyen the terins selection and - 
evaluation have seldom been adequately defined- Rather, the suggested 
definitiohs^terid to be based upon author opinion. As a result, ^he 
san^ problem is encountered when one examines ^ the p;iethora of selection 

arid .evfluation criteria that have been id^ in th^ 1 i terajure. 

" — - - ^ ' '_ ' '_ _ " ■ _ ■ 

With the exception of the study conducted by Levi "he (1969), all idg^nti- 
fied criteria have -been author, rather than practitioner, generated. 
Latham's (1974) work provided evidence th^ teachers ^air^- thterested in 
less thari orie-thind of the items which cortmonVy appear^on materials * 
evaluatibri forms. Cbhsequeritly , there is a definite need for more re- 
search to identify those criteria that are eons tde red useful to prac- 
titioners;, '..^v. - ' ( 
^ Although guidelines have begrt proposed for seleetinp- arid evaluating 
i nstruttlonal materials for the hariditapped, existing research has riot 
examined the actual practices of special educatieri teachers in this area. 
Similarly, no research has compared their selection and evaltiBtion pr^ae- 
tices with those of regular classroom teachers^. Accbrdirig tb theire-'' ' 
suits of the survey conducted by the Educational Products Iriformatibn 
Exchange ( 1977). teachers are Involved in tf?e selection of their class- 
^rpom materials slightly more than half the time" Thus, it is ironic tb 
firid that the majority of articles describing selection criteria are 
directed at teachers when, in fact, it is unknown whether or not teachers 



:servci In this capaci ty in most cases . 




As illustrated in this review of the existing literaturei suggested 
procedures for selettihg and evaluating ihstruetiohal materials vary 
tremendously. Identified procedures range from .retjui ring the practi- 
tioner to respond to five questidhs to completing a six-page evaluation 
form. To date, no evidence has been found to suggest that any one eval- 
uaition procedure is inherently better than others. 

Few of the authors reviewed have suggested what is to take place 
after a given material has been, evaluated, that iSi the decision to ' 
choose one material over another is still dependent upon the subjective 
judgront of the persc^n selecting the material . ^ 'No one has developed a 
method that yields a ratings scale of the materials under cdnsideration^. 
No cojisens^ has been reached as to when instructional materials should 
be evaluated. Spme authors have suggested^ that a material can only be' 
evaluated after it has been used -in an educational setting. While thed- 
reticaHy sound, such an approach fails to acknowledge the fact that few 
, teachers have unlimited budgets for the purchase of instructional -ma- 
terials ,ahd tha'^t such pro^dures require a vast amount of :ins/truetional 
time. It is unrealistic to^expect that teachers have the time or the 
inclination to evaluate every- piece of material used in an educational 
program. What is needed, therefore, is an effective and efficient method 
that would enable teachers to evaluate the relative merits of a given 
material prior to its purchase and incorporation into ah educationaV 
program. ► , 

Most df the authdrs whose wdrk was reviewed agreed that individuals 
respdn5ib"he fdr selecting and evaluating instructional materials eahndt 
be expected td dd sd wi thdut, adequate training. However^ responses to 
the ERIE (1977) survey indicate/ that thdse who select instructional 
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materials have ^received little traihihg for this Important function; 
Teacher trairjing programs must be considered resborisible for del i v^rinq 
quality training in this area arid hence must incorporate this eomponent 
in-wexi sting curricula. 

While the proposed research ^wi 11 riot resolve alV the issues sur- 

— — — _ _ _^ _ __ __ _v __ 

roun^in^ the selection and evalUatidri of iristructibrial materials, it 

dops, however, represent a startirig point for examining the practices 
employed by professionals resporisible for selectirig instructional ma- 
terials for the handicappedv At tHi same timi it is arit/eip^ted that 
the results of this study will jderiti^l^ those selectibri criteria that 
are important in this prociess. Finajly^ the proposed research repre- 
sents an initial step iTi the development of a procedure for permittirig 
instructional materials>to be selected on ttie- 'Msis -of a numerical rating 
system as opposed to subjective judgment- ' " ^ . " 



EKLC 



^' CHAPT€R lU 

METHOD OF 'INVESTIGATION 

The purpose of the present investigation was to develop a 
weighted ch\cklist for use in. the selection of instructional materials 
for students receiving special education services. The develbpnient b-f 
a weighted checklist involved the /foil owing seven phases: (a) develop- 
ment of field- test version of survey; (b) selection of g'xpert reviewers; 
^ (c) distribution of field-test version of survey; (d) subaect selection; 
(e)- survey refinement; (f) distributioh and return of survey; and (g) 
data analysis. . 

Method . 
Development of Fi^ ^si: Version of Survey 

-- ' ' - ■ - V ^■^■x.'- 

^Development of the field-test version of the research jsurvey began 
in_ August^ 1980/ A faculty meml^er in the Department of Special Education 
at: the University of Kansas served as a ^eoriteht; expert for the study. 
This individual is an expert in the area of instructional materials se- 
lection and has taught graduate-level courses in instructional material's 
sele(y:ion and evaluation. First it was necessary ^ identify the selec- . 
tion criteria which had previously been utilized in the literature. The. 
selection checklists proposed by 24 authors were reviewed for inelxision 
in the field-test survey. A listing of authors^ the -titles of tfieir re- 
spective checklists, and year of publication i si, contained in Appendix A. 
Each author's selection criteria were sorted into the .following broad 
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topic areas: title/name ef- product; (2) copi^ight date; (3)'autLr; 

(4) non-sexist,- noiyrac-1st bias; (5) size^ space requireTOrits ; (6) num- 
ber of users; (7) Instructions, for teacher/student; -(8) target pbpulatibh; 
(9) teacherjs guide; (10) physical chetracteristics* format; (11). time re- 

_____ _____ ____ _ *r_ _ _s_ . •i__! i 

quirements; (12) publisher; (13) adaptability; (14) reading^ interest^ 

ipstructionaT level; (15) component parts; *t 16) entry^ prerequisite re^ 

. ' 1 

quirements; (17) e^se of use, teacher training; (18) motivation,; appeal ; 
(19) research, field-test data; (20) method, technique; (21) technical 
quality; (22) content; scope/sequence, accuracy; (23) objectives; (24) 
price; (25) formative evaluation, feedback assessment; (26) amount of 
teacher involvement;- (27) other. In all, 694 selecti'bn criteria were 



identified. Each criterion statement was examined'and a decision was 

_ _^ ._ _h -__ , 

made as to whether it represented a unique Criterion statement or whether 

it was ^^duplication of an existing statement. A survey item was written" 

for each distinct selection criteria. Ah agreement of iOO percent was 

reached between the content expert 9nd the project 'investigator con- 

cerhihg the wording and eonten^ of the -field- test 'research survey, Al- 

' _ _ _ ^ _ _ _ . > . 

together, the field- test version of the research questionnaire contained 
l^j^criter ion statement ' ^ , ' • * 

Selec tion of Expe rt Review ers ^ * 

To enhance the vali^4>*y Qf the research survey, the cbhteht expert 

•___- 3L_ __ . __■_ ,___ _ _ _ _ 

cbmpjled a list of the hames.^bf 20 candidates for the roles of review 
panel experts. Individuals were selected based bh their reco^ghized in-^ 
vblvement and expertise in speci al >educatibn ins;tructi6nal materials in 

__.-_ ___ _ • '___ __ __ ■_*'■__ v___~_ 

brie bf'the following capacities: (a) affil iatibn with i nstructibnal 
inateriais publishers or the Special Education Instructibnal Material 
Center^(SEIMC) netwbrk; br (b) authorship of checklists for instructional 
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js, - _ _ - _- - 
materials selection or prdfessidrial jburrial articles bh selisctibri/eval- 

• • - ^ 

uatinn of instructibnal materials. The expert panel members' respbrises 



to the survey were essential in that they not bnly assisted in ; the vali- 
\clation.of t|e survey instruments but also prbvided a data base Upbh which 
to compare the responses of the research subjects. 
Jtf^j^i^^^ioti-pf Fiel^^ Version of Survey / 

A'^packet of information was prepared and mailed to each field-^test 

; . / ^ • _ ^ * 

reviewer at .the. end of January^ 1981. Included in^ this packet was . (a) 
a cover letter, (b) ther field- test survey^ and (c) a stamped/ sel f-^ad- 
dressed envelope designed to expedite return of the field-test^ survey . 
The cover letter outlining the purpose of the study requested individuals 
to serve as expert reviewers afhd assured'thera that participation ij the ^ 
Study- was voluntary; confidentiality of responses was^also guaranteed. . 
(A copy of the cover letter is contained in Appendix B.) The field^test^ 
survey consisted of 10 typi|written pages of reduced copy. Directions 
for completing the survey were printed at the top of %ie first page. Re- 
viewers were asked to examine the field- test questionnaire (see Appendix ^ 
e) and to circle on a scale front 1 (low) to 10 (high) the amotfht of 1m- 
portance assigned to each criterion in the selection of instructional , 
materials.;^ Participants were asked to ci»^le b.nly pne number per item 
and to refrain 'from adding fractional or ^ecimaT pointy ^the se,ale^ 
Directions for cbmpletioh of the ^cale 'were printed at_ the top of e^ch 
page pf the survey. In additibh,' reviewers were a^ked tb examine all \- 
questibhnaire items and tb cbnsider whether br not additidhal statements 

- - ■: , ■ ■ - - - - ■ - :/ r--- - 

Qeeded tb be incliuded in the final questibhriaire versibn^ Space-was . 
^rovide^J^at the end bf the survey for individuals tb 1 ist^^dthate -^ariy " - 



items they had added tb the sUrvey^ Finally participfhts wanting tb ' 
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receive copies of the result^ of the study were* asRed to print th^eir^, 
name and"address on the last page of the survey. FollbwujD telephone 
' calls were placed to reviewers who did hot return the survey within one \ 
X week after February 16 * 1981* the return date specified in the e^ver y . 
letted-. V ; ^ 

Subject Selection ^. 
An integral compbnent of this research was the identification of 

subjects responsible for selecting instructional materials for special 

- - - t- . - - -- ■ _ ' ' _ - •- - _ - - ^ - ^ - 

education students. In this connection^ one might assume that random • 

__ ..... . ,.■ . . .... \ _ 

selection of special education teachers would automatically result in 

identification of those individuals wHo *are responsib*Te for the selection 

: . 

of instructional miaterials. HoweVer, research by ERIE (1977) offered 
contrary evidence, noting that "not only are materials indeR,endent of 
teachers' variables,^ but they are selected by someone other" than the"^ 
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teacher who used them nearly 5d% of the time" (p. 27). Thus, selecting 

__:t__; 

only special education teachers might have resulted in the exclusion of 

^ ■__ ' . y_ __ _ _ . _,_ _ ■ .__ . 

those individuals who are responsible for purchasing materials for class- 
rooms and/or libraries at the district or cooperative level.: 

' To avoid identifying the Wrong population, local special education 
administrators ^e re asked to identify six individuals in their respective 
districts who v^fere responsiW^*^r selecting instructionai^aterials.^ The 

^ idehtificatibh of potenti^ subjects for tf^ study consisted of 9 three- 
step process. * . , 

^ The first step involved contacting state directors of special edu- 
cation. To this end, a telephdne- cal 1 was made to the administrative 
office of the. National Association of State Directors bf'^Special Educa- 
tion (NASDE) requesting a list of the, names and addresses of the state. . 



■I- 



50 



directors of-spegUI education In each state and the District of Columbia, 




In the middle of September, 1980, a cover letter was prepared and mailecl 
to all state ^directors of special education (see Appendix 0) . Included 

'in the cover letter was a brief statement of the purpos^qf the study0 
and a request that each* state director provide a list of Jtlti^ynames 
addres^ses of the directors of local special education prog^^ams in his 
state. A stamped, self-addreised Envelope wis incliuded j/ith each request 

; to increase the chances of the requested information bj^ing supplied. The 

; student research assistant for the project placed fol/owup telephone calls 

' l - . , _/_ 

£o/ those state directors who did not respond by Qctober 1, 1981, the re- 



turn stipulated in the letter. 

Local Directors 



When each list of local special ecJueation direeto^ was received, a 
number Was assigned to each dir^^tgy in each state, and the total number 
of directors per state was redBrded. The states were then ddvided into 
their respective Federal regions. At the incejDtibn of the project it 
was decided that 50 directors of special education would be randomly se- 
lected from each Federal region, thf^tdtal number of directors chosen 

. . . . ' • • • ..... r 

from each state was expressed ^s a ratiia^f the propdrtidh df directdrs 

per state in -relation to'tdtal number of directdrs per Federal regidn. 
The Stlual number of' directors, td be seTectecJ was expressed in relatidn 
to 50 (i.e., the total number of directors to be selected from each Fed- 



eral region). Table 1 illustrate.s how the number of directors to be con- 

- - - ^. . . ' . 

tacted fn each state was determined in one Federal region. 



ERLC 



9.- 



51 



J 



• TABLE 1 •■ • ■ 

Number of Directors of Special ' 
EducaAlon Selected in One Federal Region 



State 

A 


Number ^ 
, tbcal 
Directors 


Ratio 


Number of • 
Directors • 
Selected . 


Connecticut 


— '■ ' — ^ — 


' 90/299=x/50 ■ ; 


x=15''">,\- 


fjaine ^ 




l32/299=x/50 ' 




Vermont 


" 59 ' . : 


. 59/299=x/^ 


x=20 


New Himpsfiire 


. 28 


. 18/29^=x/5a. 




Total 


299 


• - 


50 ■ : ' 



The ej<act TO^ber of l.bc^al directors needed from each state ahd'the 



total^urnber of directors pef state was; entered into a rnicrbcbmputer 

. . ■-. ■ -_ - _ ' -_ -"_ -L 

whvcii randomly generated spts of the code numbers of directors of local 

' _ _ _ _ ■ . _ _ _ _ _ _ _ ' * 

special education programs;; Once the code numbers of the directors to 

be contacted were obtained* the names and addresses of those directors 



Ip^xpedi 



were recorded on a master mailing list to help\expedi te the request for 

_ I ji _ _ _ _ J . _ 

identification, of s^ubjects. The master mailing lists were later used to 
record and track thev^eturn of subjects' names and addresses. • 

' ^ The final step in the subject identification process c^s is ted of 
preparing a packet of information for>(Bach of the randomly selected local 
directors of special education. The packets of information were mailed * 
during the first week of January , U981. Contained in the packets were 
a cover letter, a^form'^on which to 'record tRe'najnes a^nd addresses of ' 



* -*■ ■ 



Go 



/Tfs 



/ 



52 



tehtlaiSisjjiyeetSi ahd^^^ seTf-id'dressed envelope, tfte" cover 

letter fse^: Appendix E) qotli'fied the purpose' of . th&^udy and asked ; 
■ local directors to provide, on ad" enclosed fom) (s« <^pendix F), the 

tlames and addresses of %\x individaals who.sfrl^ectecl f nstrgctional ma^ 



* " tlri'als'-fbr spegfel -edu^tjj|i std(|^'nt"s. Df tfese six, thre^ were to 
\ _ be individuals whb'sel^ted mj^rials for e-1 dintary- a gig'' students - 
''.<I)«hile thf r^^nili^ht^^>^ select' -in- 

'siructionaT m&terl^ students. The cover let t&r 

als{5 cbntainqd'^a stateiT|t1t asi^ing^ t directory that participants j • 

in . the Study was':>#oluntary arid that all responses _^wodld be kept cpnfi- 

_:_ .....1:,;' \ ■- \ - - - ' - '- ' ^ - - 

. 'de,n«^l. Dlj^ctor^ iriter'est|d ^ri receiving a copy of the results of 

. the iurs/ey were asked to ffll irr their names arid addresses .in th'e space 

proyided. To ensure that^dltdwUp telephone calls would hbi placed^ 

. ; to thi^se _indivi duals who chose not to participate, space wa^^l^prS^ 

vided on the form for ind^icatirig uriwilTirigrigiBs to parti cijDate^ 

study. _ . ' ■ *\ 

Two techmques were employed to increase the return c^-coliiple ted - 

1 . _ . • 

>fonns. The fiir^t consisted of the inclusion of a s 



ed self-addressed 

envelope for returning names and addresses of potential subjects, the 
second technique, drawn frbm marketing research, (RoberlEson S Belliri'geri 

\ ^ _ _' _ / . : 

i978), involved the promise of making a given monetary contributron td 

a charitable or^nonprofit organization after a certain number" of -com- 

- . - ■ ■ - ' ■ ■ ■ ' _ 

pie ted surveys were received; The contribution mentioned in the cover 

letter to local special education directors consisted^? a $5.00 dona- 

tibri to the Fouridation for , Exceptional ehildren, a rionprofit organization 

fblihded |)y the CouhciT for Exceptional ehildren, for every 150 names and 

addresses received by January i9, 1983. Penriissioh was obtained to hafne 
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^ the Foundation as Ithe recipient of the^ donation befoi^S letters to the 
. loca*! special education directors were printed. 

During the last weefe of January and the first week pf February* 
' 1981, followup teVephorie calls were placed to directors' in Regions I 
_ and in who had not initia:lly respOinded to the request to identify sub- 
jects. Originally, -foLl/^owup calls were to be iiiade to all -special educa« 
tion direc^(^«K5- iTi aTl^re^io^ However,' limits on the project's .tele- 
pKo'tae budget ano^he^mouht of time required to contactv^ach fodal tli- 



♦ rector made a complete followup impossible. 



'As the names and addr^ses of subjects were received, they. Werfe 



coded and entered on a \iJoi^"processor;^to ex^edi te the preparation of 



cover 'Jitters an/d envelopes when the |^s^ai;ch survey was latpr'-lta^be 
•^mailed out. 



Survey Refineni^nt 



Field- test surveys urned by the- e)^p^rt reviewers w^re checked^ 
for completion and r%IV/teWers* cdnmen^ about tfee survey were read. 
jTiean rating and the standard de^i^ibrt for ^ch survey item were calctl^ 



lated. Curing the developraerj«df .the=^ pnDj prbjDdsal,: it had bpn'de-^ 
cided'nbt to incljude in the filrfiV ye^sMoh of the research survey ehy 



^ield-test survey item vthal: did not receive a meaji importance rating of 
at least three (3.0). Since' the mean ratings for -field- test survey, 
items ranged from 3.60 to 9.50, none of "the items was bmi t ted 'from the 
final survey vers ion. \ * 

Amdr^ the reviewers* cdntments about the^sOJ^^* only -.dne'''%uggested 
including additional selection- criteria. While the A:hree suggested cri- 
teria were reviewed, they were not included In the fint^l ^version of the 



survey because they dup.licated ftems already contained in the survey 
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Orte reviewer painted out that item number 32 Which was WdrtTedi *'The 
attractiveness r appeaTi arid ptivatiori of the material to Students'* ^ * 
represeritecl two questidriSi sincf fflateriaTs may be appealing without also 



feeirig wtivatirig to studerits. Giveri thi^ suggestidrii the 'item was re 



—jt- 



^ writteri as*twd separate selectidri criteria. Therefd.rei the..firial ^<ersidri 

' of the survey consisted of 104 statements about ins^ructionaf ntrtllTals. * 
Some reviewers commented that the fieljj^-test version of the Purvey, 
which consisted of 10 pages of reduced print material, wasteHious to 
' complete. Based on such criticism, it was decided to Use A more compact 
and attractive fohnat for the subjects' copy of the surve?y- Consequently, 



*a -conmerciaT artist was employed for the .purpose of designing a surv^ 

booklelTwhich would be readable yet, when folded, would fit fntq. as tan- 

dard envelopei THe artist slso designed the booklet cover andL' laid out f 

* * 

r the copy for typesetting. 7^ The cover of the final form 6'^'the survey pro- ' - 

victed a line for recording the code number assigried to each subject as ' 
well as 'di rections for completfrig the survey,: arid a returri address. On 

the> first page of the survey subjects were a^ed to iridieate: (a) the 

■* . * " . " 

type of students fdr whom th^y selected instruetiorial jjiaterials; (b}.the 

grade level of studerits for whom they selected materials; _(c) their pS- ^ 
#• - * . 

1 . sitiori within the school district or eodperative; (d) whether or not they 
had received fonnal eoursework or training iri the selection of i'nstruc- 



tibrial materials ; (e) wh'fether or not they felt that such trairiirig is of 

value to those who select materials; (f) the sources they used to dbtairi 

information about iristructidrial materials; (g) how frequeritly they used 

a cHeefclist %r*jnaterial§ selectidri fdrrh wheri selectirig irisjtructidrial ma-. 

i . . _ _ _ ^ 

terials; and (h) the settirig iri which the selected materials were used; 

Pages two through 11 df the survey cdritairied the 104 criterion' statements. 
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triteribri statements did riot ajDpear iri the survey in a predetenriiried 
order. l\)ey typically were organized aeeording to the major: topic area 
iri which they previously had beeri iSategorized. Placement of eriterid\i 
stalemehts iri rib way reflected a presdmed amburit of importance for each - 
item. Half of pag^ 11 cbritSiried items 105 through 109, while leaving 
space for subjects to fill iri arid rate any additiarial" selectibri- criteria 
othey felt had beeri omttted from the survey. Direciibris fbr cbmpletirig 
the survey were pririted at the top of /page twbj the meariirig of the rating 
scale was repeated ^at the top of each page of the survey. Subjects were 
instructed to read each statement b'f the selection criteria arid to circle 

: ■ ' ■ ^ • , 

_ \ _ _ _ _ •_ _^ . » . . _ . ■ . - - 1 

on a scale .from l'(lowjr to 10 (high) the amount of impbrtarice they at- 
tached to /each criteriori when pel ectirig fristructibrial materials' for spe- 
cial educattori students. F^ndlly*' participarits were asked to' circle ' 
q,nly (jne number per itefn.aRd,tb refrain from adding fractional or decimal 
fioints to "the scale. 'S^p^ce was providecF,oa-.^lig^twel fth page of the sur- 
vey ^L)k let for subjects to make any additional comments abou^ selection 



of instructional materials. A statement thanking subjects for their pa r- 



r .tixipatiori .in the stu'd^ was pHrited on the thirteenth page of the- survey 
^ where space was also provided for subjects to print their name and address 
if they warited to r^cieve a copy i>f the study results. A copy of the fin€i1 
version of the research' surVey is contained iri Appendix 6; / / 

Bistritiution and Return of Starvey - '■ . * 

'A packet of materials v/as prepared and mailed to each identified, 
'subject duririg.the first week pf April, 1981^ The packet edri^isted of 
a cover letter, the research survey, arid a stamped, seTf-addressed enve-(^ 
Ibpe. ' The cover letter butliried^the jDUrpbse x)f the s|udy atid assured 
subjects that participatibri in the study was Vo\uj\^}^\ arid that all re- * 
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... . .■ : ■ - ■; -^."S . ■ ...56;- 

r _ _ „^ _ _ _ ■ 'i-' ,. 

spopses v^ould be confidential; Subjepts were tolb that a $5.00 cdhtribu- 

t;i on would be rnade to the Foundation for Exceptional Childn^n for every 

IBGv^fveys completed and returned by April 22, 1981, the return date 

Stipulated in the cover 'letter. A word processor was used to tyfSe the 

^ inside address arnl to personalize the salutation in each subject's let- 

_. '_ ._ _^ 

ter. A copy of the cover letter to subjects is contained in Appendi5( H. 

A' code number Was assigned ^jl^ch ' subject when his/her name was 

- * _ _ T __ __ ■_ , 

received from the local director lof special education'. For ease in 

traeRing the return of surveys, each s'ubject'^ code number was recorded 
on the cover of the survey he/she received. The same code number was 
also recorded on; the dfitside of the^envelope containing the cover let- 
ter, the survey i and 'thf rettirn<envel ope to assist the prpject invest!- 
' gator ahid resejarch assistant in verifying, that packets of materials were 
* mailed to all identified subjects. 

K followup postcard (see Appendix I.) was mailed to subjects who 
had ndit returned the survey by the last week in Afiril , .1981. Also,^new 
surveys were mailed to those individuals who responded that they had 

. lost thei r copy. • , ' • " ' . ' . 

'"<'■•■ ^ ' . ' ■ ' . ' 

As surveys^ were returned^ they were checked to ensure that tfiey. 

.had been completed. Returned surveys in which nothing >jdd been written 
were marked, as invalid and wer^ not inclut^ed in the cdmpilatibn of sur- 
vey results. Attempts were made to correct addresses dh surveys '"^-^ 
turned by the U-S. Postal Service because of an insufficient or incor- 
rect addre'ss . Addresses on returned surveys were first checked to make 

sure they were correct. In some instances, address corrections were 

/ . . ■ . • . ' 

madeir and the surve'ys were mailed a second time. In other cases where - 
the address was the same as the one supplied by the director, the 
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survey was mailed again to a given individual — this time in care, of the 
director who originally identified the subject. . The data reported by 
subjects an page two of the survey were coded, and code numbers were re^ 



corded on the inside cover of the siirvey to enable keypunching of that 
information simulta>ieously with the subjects* numerical ratings of se- 

lection criteria. Surveys received after keypunching of the data was 

^ _-i / 

-v: begun wer^ considered invalid and hence. were not included in the compi- 
lation of survey results. ' . • . 
D ata Analysi s 

* A computer programmer was hired to prepare a prograim that wauld 

yield a tabulation, by state and region, of S'ubjects' responses to the 
descriptive data reported onypage two of the survey. ^Iso, a computer 
program w^s used to compile subjects*, ratings of each criterion state- 
/jDent and to calculate 'the mean importance rating and standard deviation 
for each survey item.'^,.:fi ebbnt was also- taken of the number .of subjects 
who fa) listed additional selection eriteria, (b) wrote- eomments at the 
end of the survey, ahd/br (e) 'requested the results of the survey. * * * 

; 1; ' " A Pearson produet-momeht correlation coefficient (Fegusbhi 1976) 



^^A^^.^^ ' ^^^^ the cbrrelatibh between experts' and subjects' mean • 

r*atings bf ; survey i temsy: Prbpbrtibnate scale wei gh^^is. based <an means 
(Edwards, 1957) were used to develdp. a weighting ' system for the selection 



bf ihstructib'r^ial materials. * . ^ . 
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CHAPTER IV . • .. 

RESULTS ANDDISCUSSieN * " 

The pdrpbse this research project was to^survej?, a national sample 
of individuals responsible for selecting instructiqnal materials for spe^ 
eial education students in order to ascertain the amount of importance^- 
they assigned to selection criteH^^^ the litera- 

ture. Based on a. ^ of 24 checklists for selecting insti^Qctional 
materials,." a lD4-item research questionnaire w^s constructed. 

Ih this chapter the fol lowing elements of the study wil f be dls^ ■ 
cussed: research questions, subject selection, field- test survey distrt- 
butiorl and retur^h, survey distribution and return, charicteristics^ of 
the sample pbpulatibpi wei^fcti^ig of survey i terns, survey results^ addi-. > 




tionaT selection cpitfsri a identified by subjects, and the intended Ji6^*.% 

^- % ' - • ^ ' - > ^ .1 .*'- 

of -the "^(shickl is t. : — — : V -J^J>^J^ ' 

Research Questions . ' "^^^ , 

- : ,v ^ , - : . . ■ /^-^ 

As a part of the data 'callectibn, subjects Were asked to respond 
to a series of questions and^dr statements for the purpose pfje£^^ 
ing the basis for the analyses of the fdlTbwing gUestibns: 

1. What were^ the mean importance ratings assigned to 
" \ identified selections eriteria't^ subje . - 

2. What were' the mean importance' ratings assigned to • 
identified selection, criteria by expert reviewers? 

V. 3. What was correlation between mean importanceratings 
. ' assigned to selection criteria by subjects and e)jpert 
reviewers? - / ' 

58 ■•■ ■ .. c 
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.For what types of students did subjects report 
seleetijig ingtroctional materials? 

^HJiat percentage of survey resf)ondents selected \ * 

^ - ••• : - - ^ / - ' ■- - - ■ ■ ' ■ 

' materials for 'eleni(5htary-a secondary-level . • 

stud^ts , or both age groups? 

What positions in school dis^tj^icts or cooperatives 
were held by irfdividuals responsible for selecting 
instructional materials? > 
What percentage of individuals selecting instructional 
materials for special education students repbrtecj hsivirig / 
completed foHiial coUfsewdrk Q,^i^ecei ved traihihg in this 
area? - . ' ' , ' - 

What percentage of subjects indicated that *the^^CDh- ' 



sidered that%irmal coursework or training in the 
selection of instructional materials is of value? ; 
9. What sources did subjects report ustng to obtain 
information about instructional materials? 

id. What percentage of individuals selecting instructional \ 
materials reportiid using a checklist -or materials - ^ 
selection form when making selection decisions? 

11. in what setiings were the selected instructional 

; materials sel.ected by s'ubjects used? : 

'•'■]*■ - ■ ' ' 

' />.,-,. 

Subject Selection ^ ; ^7 

An integral part of the research project involved the .identifi- 
cation of individuals in school districts or special education cbopera- 
stives across the nation who* ^re responsible for selecting instructional 
^•^malerials for. special education students'. , , - v T 
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State- Bi rectbrs 



iriitially, the state directors of special education programs in 

each state and the District of Eolambia were contacted and asKed to 

submit a lifting of the names and addresses of the directors of local 

education programs in their respective stateV Forty- five (45) state 

directors provided the requested information, ©rie individual replied 71^^; 

— • , _ ^ 1 . ' ' ^' 

that his state did not- wish to participate in th^studyi while ^ 
State dir^ttoKS did hot respond to the request for informa'tioh. In ^'^'^i'^ r^t^ 

V 



- 88,24% of :,the nation's state directors of special education provided '^Sf^i^ 

-- - • ■ . ■ ' . • 

^e ihformatibh necessary for the seicbnd phase of subject identificatibh 
process i cbntacti rig directbrs bf Vocal special education pro.grams, 
' Local Directors , . * . " . ' 

~ As each state list bf local di reefers of sjDectal education was 
received* a number, was assigned to each director within each s^ate, 
and the total number of weal d?rectbrs> per st^^te was recbrSed. The 

■ N ■ .-^^ _ - - - -, - - ^ ' ^ ' ^ _ - - _ - -_ _ - ' ' 

•-^.r^^tates were grouped accdrdirip to their respective federal : regibris . 

A ' ' . \ . . . ft*' . . ... 

Due to varying administrative structures across states^ 'the number of 

local special education directors varied greStly among the states. It 

wa? previously deci^^d^to select 50 directors from each of the 10 Fed-- 

•_ ' - - __ . 1 1' ^1,.. _ .S 

eral regions. The precise number of special education directors. to be 
contacted in each state was calculated an -the basis of the proportion 

of local directors per state i n ^relation, to the total number of directors 

: - _ L_ " _ _ -^i. ■ 

in each Federal region. Table 2.ctart±'ains a listing of the number of 

* . '■" ■ ^ 

di^rectors in each state, the percentage of the number of directors in 
.relation to the total number *Sf directors in each region, and the actual 
riumber of directors selected from each state. 
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:TA8tE 2 

Hiseer of Olrectort of Spcci*! Education 
• Selected Froo Uch Stau 



J? 



Stat e 

REGION I 

r Connecticut 

' Mal"t^ y 

New Hampshire 

Vcrnont 
- lotal 

REGION !I 

New torfc 
i New Oersey ^ 
Total 

;.REeiffii ILI^ 
j.^^ Itei^jware ^ 
Ha ryl a nd _ __ _ T 
Pennsylvania 
* ■ Vyt^ini a .. _ 
W. Virginia 
6.C. ^ 
lotal , 

Region -IV 

. - 

. rijrid^':. 
Georgia J 
Kctitocky^ 

' - ' U. Carolina 
^ ' S. Carolina 

REGION V 

K - - - ■* 

^ i1uhi<jan_. 
•fli lit ir sola 
Ohio 

lolJ 1 

REGION W 

Arlciinia^ 
IjOuisit'^n^ 
Rrw Kc/icO 

. ^ Rtr.io:j vii 

I g ,yC! . 
ToUl 

RfGION VMlf 

Colorrc^^y-:^^ 
K:>nlono '^^0 
N. i)ol:oU'-i^ 
S'. Dal.ot,a 
Utah 
Wydnn Hq 
lotdl 

REGIOti IX 

^ Arizona. , 
paHfprhia 
Llawdn 
Hl»v«j da , 
. -.Total 

^ ^ REGION X 

Aiasf.a 
Idaho V 
Orcqori \ 
Ha'J.iitTtdn v- 
Total 



Nunber 
Di rectors 



-90 
132 
18 
59 



21 
6S 



17 

29nt 
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-nu 

' 171 
IS]' 
146 



P9 
85 
198 
106 
JG 
73 



93^ 

B9 . 
BO 



63 

T9 



48 

31 

34 
«0 
4n 



nuiA»er of 



109 
68 
"9 



03 
|ii rrt tot 



Perccnt-of . 
R^ional Total 



Selected for 
Participation^ 



61 



30 
44 

6 • 

20- 



68 

100^ 



6 
9 

n 

S2 
20 



n 

21 
1? 
18 

12:^ 
Too ■ 



26 



19 

'100 



i5 

10 
14 
12 
49 



Too 



20 
17 : 
13 
14 

If. 

20 

Tuti 



56 
30 
5 
9 

1^0' 



11 

13 
27 
40 



15 
22 
3 

10 



34 

26 
^0 



s 

2G 
10 

_ j_ 
TO""' 



4 

11 
10 
10 

9 

6 

-3cr 



8 
8 
17 

9 
1 



8 
5 
7 

,6 
?4 

"T9"' 



40 



10 

8 
7 
7 

-B 
10 

T6" 



20 
Ifi 
2 
S 



^el?>. ('•<). fui jilt tUI|>.<Uu 



'jOO . 



r 




The. exact hujnb§.r of loeal^i rector? nee'tted from each state and the 
^ number of <li recto rs^ ifih each -^stata was, entered into a microcompater 
.which, in turn, *was used to randomly sefect^the previously assigned code 
.numbers to directors of special edticatibnVin -each state. Using these. t'^ 
code numbers ^ master rftailijfg lists were ^ditipiled ^f.ihe d to be 



c^^ntacted in each state. s 
Q4iest4^nnajre Respondents • / 
• ^ The i uidomly' selectend dire^^^ w^e asked, tej 'i den f^)F^ and* list 
^he nam^s and .adbresses of six vidiaTs resporrsible fo^^se^e'ct^ 
^instructional 'material^^r-$pecial edUGatibh students in" thi 




or cooperative. ,A surmary , ^ ,regiQn, of-ttie local. tfiretW?^^ 




-1- 1—--% ■- - - ------ 

to this, request appears 4^ Tabl^ ' 3. 



■ tablet's; 



Local Directors' Response to Request to -Id^intify 



Pote^laT , ^Respondents v . • * > . • 



Us^tele p Usable hdt^tb _ - 

Regiqn'^ : Returns ^Returns Parttcipate Total 



--lot*! ^ _n of SS 
RetSrns Identified 



rJ I 



I 

A\ 
III 



'-IX 



/ 46 , ,92^ 

'50- "6CJ 

. \' ..35 ■ 70 
>.,432 . 64 
32 ' 

~Wr } "~6 




■ t 



46 

s 

' 32 
^ S3 
- 38 
V^7. 
33 
36 



92 
56 
90 
54 
64; 
66 
76 
74 
66 
72 



^v^ = 50 for each region; 




230 
119 
213 
125 
142 
159 
186 
187 

'150 
142 

1659 
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. Fiv(5 hundred directors of special educatidh programs^ represeritirig 
'45 states and tHe district of Columbia, were-asked to jDrbvide the riarries 
^ahd addresses'^^f potential subjects for this^udy Of ttie directors 
Si cohjtacted^ 327 (65%) ^ returned the name arid address' of at least one 



pdtetjtial subject: ^Brity-eight directors^ 5,6%^ replied that tMy . 
did, rib]t. wish to participate iri the stuc^. jfffie hUridi^ed fqrty-fiveV"'29%r ^ • 
did not respdrid td t!>e request td ideriti'fy s.ubjects. A total df 1659 



•^dter/tial subjects vfer^ ideritified byMdcal directors of special edu- 



• catidf> pro^.ams. - , ' - - 

F - ield-Test Survey Distriteution 



r ; ^ ' To-prdvide a measure of the cont^ent yM^|dlt^>qf^^ 

* vey, ,a field' test version of the survey ^wa^^fi^^t;ld and mailed^J^^i^^^^^^ 
nil vi duals* who were chosen to ierve ^^expe^^:^^^ 



] >*^c»nt^"n5 t^e^^^ ^ dis±ribUtn;on^an^ retaffi 

V*T mailp% to^xfert. panel menib;§rs. ^ J " , f ^''a* r ' ^> 



■Field-Test Survey Di^: 



tiQ^ri anc 



turn 




ri df ^ 

^urveys^-;/ 

Oistrn'bjted 



^ur^l 
Returned 



% Usable 
Purveys 
[Returned 




15 




^ — 

n cho6sing 
TTot To 
Parti ci pate 



Respons.e ^ 



Return 0 



1 



90- 



Of .the 20 suryl^s mailed^ 15^ 

vij^i^ridivi duals returried this surypy stating that other commitments preverited 

_ ' " ?V • - - - < 

them frdm servilfg 



usable stirveys were retyrried. Three 

jve'ril 
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rfTreview^rs Two. potential panel members did 

__•£__ _._ _ 

not respond -t^ .i^e, request to participate in the study. In allj^ total - 



64 



:7. 



response of 90 percent was obtained from those individuals who were 
asked to serve as expert panel members.' 

The expert panel members were Tskedio examine 103 criteria for 
selecting ilistruciional materials and to rate on a scale of 1 (low) to 
.10 (high) the amoont^of importance; they assign to each criterion when . ' 
seleating\i^nst^^ for special educati6n students. After^^ 

the expert^ ' l^rveys were returned, a^mean importance i*at1.ng anS the 
•standard deviation for each field-test survey item was calculated. The 
survey items were then rank-ordered from the most to the least important.?/ 
selection criwk 



ttt permit comparison with subjects* survey ratings. 

I * * i Survey ^Distribution and Return 

A packet of infbrrriatibh cb^Hsistihg of a cover letter, the research 
survey* and I |t^ped^^self-add#^ssed' ret ehvSlbpe was mailed to the 



1659 individuerls ^oS^ti^ibd as respbhsijp for selecting instructional 

- V- / . - - ^: - ' _^ - 'i^' -- - - _ 

materials for special education' sMdents ^ A scimmaty by region ^f the 

... _ - ' _ : ._ ■ 'i-. /. 

survey distribution and return is contained in Table 5/ 

TABLE 5 

/ Survey Dts tributiph and Return ^ / 



/ ' Usable_ - 

\ - > Surveys 

■V Region Mailed^ Returned 



Per^rit 

UsabTe 

Returned 



Tdtal 

Invalid Returned * Returned 





: , : *-V - ^ .65 . _ . 

Out of the 1659 surveys mailed to subjects, 1094 (65.94%) usable surveys 
v^re retu^ri|d -to tKe'Jr^ct investigator; Fourteen (14) surveys were 
cohsidered to be^invalid for one of the following, reasons: (a) they - j^,^ 
. jwere returned wi th- no responses ; (b) they were re turned^ too late to bei v. 



key purjche^; (e) th^.subject repl I'ed that he/she did no^ select ^mateK^a^s 



special education students, 



Results of Followlip Procedure ^ 



^ A pbs^^rd was printed and mailed to subjects who had not returned 
r r^sear?feh survey by the last weeR in 'ApVil, I98i. A sumrrian^, by re- 
Jion^ dfj_t(je results of the fbllowup by postcard appears in table, 6. 



■ f 





> 



A total of 234 surveys were .f^aeeived/frora^tfte 768 ihjjiN^^^ whoinj:.^>^ 



.4 



the fdlloiSup postcard was ma^l^ed. ^Jffe average .^r^r^a-ge d 
returned in_re^dhse td; the^ fdllov^p* reminder wa^;30..97. • 
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Characteris>tics of this Sample Population ' 

Subjects were asked to respond to a sei^ies of questions and/dr 
statements for the purpose 6f arriving at a descrtprtioH; of the sample 
population.; I- ' ^ 

The first statement to^which 'subjects were Isked to respond was 
"Please indicate the type(s)^f handicapped students for whom you se- 
lect instructional materials (e.g., mentally retarded, T^f^ng dis- 
abled, etc)". The respori^es . to ^his item by individuals' siirvi^yed are 

cbfttained in Table 7, V \ " * ' - 

• \ . \ * TABLE r .^ T^'' ' -^ 

•^-jf^^v. Type of Exceptional Student for WHorn Materials Al^^Selected^ 



-iff ' 



jJ'^- S/vPer^entage oT 



Type of Exceptionality . _ : N'^^ J?espbnse" 

, , : — _ . — •■ - ' . — . — : — _ 

EdUcable Mentally -Retarded . ^ t ,24.64 

Trainable Mentally Retarded • ^& ' 5.66 

Learning Disabled . P /i iB23, f _31..5g 
Deaf or Hearing Impaired ... - * • ^^^Jk 

yiSUallv TmhairpH ' * ' " ' 70^ ' -^"fi^^ 



Visually Impaired : " 29^ 

Speech/Language Disordered . 121 ' v'* r 4.64 / • . 

Gifted ' ^ / ; ~^1 

Emotionally Disturbed ' ' ' 36& : * 14:1)1 % f 

Severely, Multiply Handicapped ^ ' ; ^ \ 107 \ ^ ' ] 4ni^ _ : _ . ^ 

Chronical ly-pr OtHer Heal th. Impaire . ^ % : • . '■^ ■:'^'r^--^:'^ ^ 

and Physically Handicapp^ 123 ' 4.7£- ' \^ . ' ' . 

Preschool ^Students .• ^* * - 1& : .6? 2 ' 



Total^ ... ^ ■ 2f Of ^ IDQ.OO 



Select IJai^ rials for^^l Exceptidn^ality 4B8 42.78 - 

Select Materials for'2 Excef);|1onalities v236 21.57 . S 

Select 'Msierl^S^f^^^ , 1^7. 18.91/ 

Selec^^Max|Hals f6r 4 ExcTeptibhali ties 77' 7.04 . . 

ec t-W^ti rj afe ^ ^^5 E xcept-iopal i ti es 40 , 3.65 - ^ t | 

Select Vidi^T\0% ^^^rf than* 5 ExCeD*r- V _ " \ 

tidnal^t^es '"^'^ '63 5,75, 

rjci Response *. ' '-<.:'"- ■ . ' 13 ^-^^] iVig 





Tpta^ ;NMrnfee Survej^f^ -^. f ^ ^ '6^,^ ;T 99.97^ 



Subi^ct^ cbul d trid*^ca*te are selected for more 
"fife^n^^e type of excep^ti;§nffs^^ 
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As indicated abb vsj the majority of individuals s^Urveyed selected 
materials for either egUcable ra^^ . 
students, the rie>:t largest group for whom materials are selected was 
the Emotionally disturbed. The breakdown of resjDdhses to this questibri 
is quite similar to the estimated preyalehce of handicapped students 
vwUnder the age of 19 as reported by BlackhUrst and Berdihe (1981). Fifty- 
six percent of the subjects reported that they choose instructional ma^ 
terials for two to five or. more types of exceptionaV students. Of that 
gr^vip'y ' the majority select materials for two or three_ types jif excep- 
tionalities. Itlis possible that the individuals^ who rep.q/^'ted that, 
they select materials for two or- three types of €xcept1oiiS^studeq,ts 
ma^ be providing serviges tfi' cro^s-catego'r^cal pn^grams . - 
* Th? second statement to which subjects were asked to respond *as, 

". ■ 1 .__ ._ 1 •_ ■ .' _ _ • ^ _ ■ • 

^ "Please indicate the grade level of studen.Fs for whom you select in- ^ 
striidtio'nal materials". Subjects' responses to item 2 a^re reported, ' - "^S 



^by^percentage, in tabte 8 



TABLE 8" 




Age' of -Students for Whom Materials are Selectfed ' - 



Age of Students , '6, 




N 



Perc^tage 
of Responses 




'y '- ■ - E I.eme n ta ry A ge ade n ts 
Seeandary Age Students 
;'B©tb . 
^No R^pb^lse 
'ToJ " ^ 



'415:, 





38. (?3 
31.99' 
28.^8 



s 

rrio 



jects/'respbhses Were fSirlty evenly divided among the^desjbl^ 
tudent^ age groups, for whom' materilal ^i^j'^^seTe . ']^'^^^ f'^^3^^^^, ^ 
re than ©rie^thiri indicfllgd.^hat thW^is"el'g^ materials 'lorfc^l^n^^^^ 





00 



..i 



,3 A 



age students while approximately another one-third choose mateVials for 
secondary age students, and slightly less than ^ne-*th1rd reportid 

.__ i_ . * 

selecting materials for both a^ge groups. * • 

,\ The third statement to which subjects w^re asked to ^respond '^as 



"Please indicate ^bur position in the school distript (e.g. ,^sel f-cfltfi| 
t^tainedclassrbpm teacher, resource room teacher, principal, director 

i * — _ 

^^''*)f" special educatioh^r coordinator, ^tc. )-'. Subjects' responses are 

-: ^ 

/ reported in Table 9. w-. ^ 

TABbE 9 



^1 



jects' Positioned) in Schod]. District 



tion • 



1- 



Sel f-CoiTta|nedv Class rGomCTeacher 
^source Rffom T^ i 
Iriner^nt Teacher ^ 
.Principal • f ^ 

rvi-soV, :Ps|^^i1ogisti5 



i ?4 




Eoortiin^lDrw Supervi-soV, 
. eb^nsuit^r -"^ . 

Director of Spietial Education 
No Response . 
Total • . 



Qne Position Reported 
Two Pbsi tiohs F^ported . ^ 
^ Three Posi lions Bep^rted 
More' Than Thr^^Pbsitibfts 
^--^^(^.NovRespops^,^ - • 
^-^^ ;Tptal i^umfeer of , Surveys 





Percentage 




of Responses 


257 


* '■ 21.31 


568 


47.10 




■5.07 • 


32 


2.65 


273 .' 


22.64 


> 33 


- 2,74 ; . 




• '■ - .SO--- 


1206 


100.00 * 


977 


, 89.31 • 


'110 


10.05 


1 


/ .09 ■ 




0 ■ 




.55- - 




^ ioa'.-e0 







*»^SubJects*%)u1d if^icate "more [than 1 posi*tion;, 



arly fial f ,^(^^7^rd%) v^f 't1ie subjec\s^ v^ho^^^pes^onded to the survey 



\x\(i\zj^ij^,k\\^t^^^ a^ resource^room-teachers. The next* 

-largest^grbup ^f* respondents consisted ofaindividuals^ho hoTd.'posi tior 
thli r respective districts in a supervT^ry capacity.' Subject^^ / 



jndidaiting thatythey serve as self-contained classroom teach^/ 
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ide op' the rthfrd' largest (2U3%J^i while the- remaining respondents 

rejDbrted that they are eitfiert ftTnerSnt^ teachers , . principals , or dirfec-; 
tors of special education. Although^'l'.Qie maj.or^^^ icidi- ^• 

cated that they hold one. posi tion^> tfrn^ercen^ of ,the individuals sur« 

■ _-■ - -- -■ • ' • :d r^-v- - ' • ' ' • • •• 

veyed indicated that th?;^ serve in twpfpositioi^ xltv their F^^^ 
sch^T distfricts. ' ^ '^ jV- ^/V: ?: ./ 



K * * 



The fourth question to which subjects wene asked ^to. respond* w^^^^^^ 
'•Have ydU received formal^ coursework or traini5tg in the- sele^ion • 
instructional materials for'hahdi 
to this questidh\are summarized 



iicaoped studehts?'^^ Stibjects^'^-r^sppises- ' 
in f^le 10. • ^ ^ ^' ^ ^ 



X 



• ■ -Vl . : TABLE .V^ i ' ' . ' i 



Sub3ect$^''frgpar$tidh^pr Selectijig IristrUctidrial''|Hat^ria^s^'''' ' f 



I' 



' , Percentage" 
Response - V - J^.- " " of * Respcwis^ • : 

Recei veU. Forn^ Cplirsewdrk^^gi|^ '[ 66f ' , ^ 6a.i62' v^*-; ^^ ' 

No *Fonnal^ Cojurs;ework or^Jt¥iMng^ • - 417 .-^^ 38.i!0 - 

No Response . ; - - - V> " *^_13r'^ ' f.lg . - ' ' - 

,j -^Ai':' ... J^...., ' V. - ' > V / . ■ • • . 

subject marked both respcm^^ 5, j- . ^ : • ' ^ - . 

. ______ ... .. . . ... 

More thrfh half of the' 'i ndi\?h'daa5^^ reported . hav- . , '.V^ ' 

__^^^.:._^____ .....t .... .:_#_:;_^:_'%^ . . - ? 

^ing cq/npleted caury^worV'pr, training jto thi&^-area tjfc^mate rials seTectidn. • 

V _'._.._.:,■ » '/'P.:..^___i _...___^ :: ^ ^.Ky .; 

Howe^eri 38"5erc^nt^ ifidic&t«bi^lthat K received coursework or v / ^ 

trainin^in;<hTS a4^. i'- .V ■ ' w • " ' v . ■ -.' 

Subjects -wey^'a^Kfe^-^ to a fifth questio^f /l^Do yo<j fee|l r ' ^ 

that such "trafni n*g;.is of^ iil^'^'^S"'^?^^ select instructional • ma- // * 

terials?^' The respons^^^^this ^^uestion ar^ presented in Table 11. ' r . 

■'^ ■■ • : ' '>^ --^'" ■ -^t ; ' ^ . ' , • 
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Sp>'de1^ts^ Percep of the -Value of Training \, 



^ , ii^ * ' ' ' Percentage ^: 

: Rfesppnse ^ , N^. of Response 

. : Trainihg Is of Value * Sf4l 85. 78^ ' ' ^ ' 

. : ^Trainiiig is not of Yalue « . 101 ^•21 * 

No Resp^nse 55 S!bl . • " 

Total • *"ie97 lOoioQ ' 



^Three subjects- marked both respDnses; 

The vast majonty of respondents (85,78%) cbnsi^^rfed training to be of 
value>;With fess than 10 percent responding thaUs^ch training is not 



valuable, 

■ ^ ,■,-'■■«'■'.■'■ • - 

For c^uestMon numb^V, six, Subjects were as lied to i.ndteate' the sburce{s') 

th^y "^yse to obtain infarmatstin abbuisiristrtjc|i-6na^l Respq^ns^s' ; ^ v 

to this "item are Imported in Table "1^.- ' 

K\ . TABLE 12 



■ \ 

Subjects' Sources of Info^ation AboutvTnslrUc^idhal^H^^^^ • ' ^ 




r. - , ■ .. ' . ■ Percentage 

Source ' ■ . \, %: Na of Re:§potises 



w - 

"6/ 



Professional Journals , - ^ , ^^713 \ 15.92 

.rPublishers' Catalogs' , / * : \l013 " 22^62'\ 

\ Advice of Colleagues . : • ' -'^^ 9^43^ 21.05 

Materials Displays at Cdhferences i'^ i.879 19.63 

; Inservice Meetings . 7t)5 ^ 15 -74 

Other • _ - ' ' 4! 93' 

No Response * .n , 

Totals , > ' ' ^ 4479.^ ^ 100.60' 



/Subjects could indicate md re than dfie source. \ . 



•Subjects responses to this question were fair/ly ^vehiy divideel ' / * 
among the possible chpiGes. (publishers* catalogs were mentiahed moit 



frequently as, a source of-infomiati^n» with the advice of cblteagufes 



7JL 



as the seporid most' f-reqiientV source.^ TogetHeri tHese two' s 



sources .^lade^^^ 40 ^rcent of the. total response td question six. 

TThe 'third to Be^ materia Is displayed at cohfer- 

*"e.nce6'r^f6^^^ professional jdUrhals and'ihservice meetings 

-^^rSabjec^i Jiere a.U to indiciate any other sources they might be 

usirrg^ in a specially- designated space on ;the survey. Publishers* rep.re- 
f / ^ ^enta^iveSy .pniversityvpersonnel V and colTegje cdursework were merittoried 
I . ''TOst often in :tfe ''other" categgry. . ^• 

f 7 -jThfe 'Seyenth -statement t«n^ich ^subjects were asked td respond wa^ ^ ^ 
' PI e/ase: indicate how frequently you use a checklist or materials selec- 



' r t^on-. forSn in sheeting ins true tiona Inmate rials for^handi capped, students" 
' The pe?c^ntage?of responses to^this question is .descrii^ed in Table 13, 
■ V / .^^ . -fABLE 13 ' . ■ 



Frequency with Which Subjects Use a ChecKtist to' 
Select Instructional Materials, 



' ^R^ponse 



Percentage ^ 
N of Responses 




"'always 
^. -Occasionally 
Never °* 
No Response 
•Total 



84 
472 ■ 
'492 
• 4Q 



7.68 
43.14 
.44.97 
• 4.21 
100.00 



V 



^. Thefmajori ty' erf responses: (88%) to t+iis t^ueiti-en were nearlA^ evehly 
dividjfed amon^*th05ei.^ "ocqasionally"' or "never" to this 

questiifh. A very ^ma 11 percentage '(yv^l^/^) o.f ^ respondents indicated 
^hal they always use a checklist when selec^^ing materials. 

^ The finalvstatpment to which subjep|s were asked to respond was^ 
"Please indicate in^hat settings are the ins^tructfonaT ma-^tericils i>s 



which you select". Responses to this term arie Veported-.in Table 1^ 
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. •■ ^^^^^ - • 

Settings for Whldh Subjects Choose Instructional Ma"^|^^^s 







Percentage 


Setti ng . 




^ of Responses 



Own GlBssrbbm 

Others' Glass room . 

School Library or Materials Genter 

District Library or Materials Getiter 

Other 

No Response 
Total 



839 
616 

169 
142 

5_ 

1993 



42.16 
30.61 
■11.44 
8.48 
• 7.12 
;25 
100.6,0- 



vfSUbjects could #ndi cate more than /i setting. % . 

The largest single category of those who responded to this questiCiR' 
(42jplO%.) i~eplied that the raaterials the^ select are' for use in their 
awn classrooms. However^ 30. imported that th£y select materials 

•for the others Classrctoms. Nearly 20% Of the resjDCindents to this ' 
questvon replied that they are responsible for choosing materials for 
use in school or district .libraries or material centers. 

; . . r . Hetghting of Survey Items . 

ProRortiohate scale weights based oh. means (Edward^, 1957) were 
used in the development of t(ie weighted i-ns troetidnal- materials check- 
list. Weights wer^ assigned to each survey item on. the basis of the 
mean importance rating awarded by subjects. For the purpose of cbrrH i 
^ parisbn, wei ghts. were aUd assigne'd to survey i terns ranked by expert 
' panel members. Table 15 contains a listing of mean :ijTipdrtance ratings, 
weights^ and ^ the number of survey. items assigned each weight for both 
subjects and exjDerts. ' . . 
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TABLE 15 






Weights Assigned to Survey Items 




Mean 

Importance 
Rating 


f 

Weight 


Number of 
Items Rated 
by Subjects 


Number of 

Items* Rated 

by Experts . 


8:50 

8.00-8.49 

7.50-7.99 

7:00-7.49 

6.50-6.99 

6.00-6.49 

5.50-5.99 

5.00-5.49 • 

4.50-4.99 

4.00-4.49 . 

3.50-3.99 ; 


r 10 
m 9 

8 
7 
6 

. . 1 


25 

24 , . 
23' ' 

3. 

1 - i 
:i f ■ ■■■ - 
2 
0 
2 


. . 20'^ ''^ ' ^" 

- ; 18 J , • 

■ 11 ■■ 

' ■ . -4" ' . 

■ ■ 1 ■ V 
■ ' 1 '. •. . 

2 ' • ■ ■ ■ 



The results obtained from subjects* ratings of the survey it^irB^io^Jicate' 
that 69 percent of the survey content was assigned Weights o^f either 
10, or 9. In eor^ast, only 8 percent of th^ survey's eohteht recetved 
weights of 5 or less. These findings offer evidence to support the rib- 
tibn that the majority of the identified: selectibri criteria w6re cbri- ^ 



sidered tb be impbrtarit by thbse whb •'select instructional material^. . - 

\ , __ ^ ■ _ . _■ ^ ' ' i'-y 

The bverall results bbtained from the review ^pariel *s ratings of - - 

survey items are qujte similar to tffbse received from the subjects . *^ 
Thus, fifty-three percerit of the items rated wer*e assigrfed weights ~^ - ^ 

ranging frbm 11 tb 9. Cbriverselysi 13.5% of the iteSjs were we^htSd 

frdiD 1 to 6. -.^ , ^fS^ 

' . - • .. . 

, • Correlation Bet ween Subje c ts' arij Experts' Responses . : 

• : 5 ' ■ ' * 9 

A Pearsofi product-rnpr^nt correlation coefficient (Ferguson, -1976 . 

^- J . ^^V^ . . ______ ^_ _ y 

-was calculated to provide a measure of th4 correlation betwein sgbjects' r 

and p:Jperts' importance- ratings of the survey items. The 'Correlation >^'' 



betwq^n jthe- resporises of .two-; groups was* +-.81. ^ 



Survey Res u Its 



er|c 



Tables 16-21 will preserit subjects ' and experts ' ratings, of sfi^ve^^ 
■ items in descending order according to rank and weight.; For the purpose 
of cdmparisbn the e^cperts' ratings of ^ach item will be presented next ' , 
to subjects* rayngs^qf;tHe item. A list of slib;pt$s ' resp^&s to the - 
survey i^ presented ih'rank order freni/mbst to l^eas.t important in Appen- 
{ dix J. The expert reviewers ' responses are presented in rarrfc^ order in 
Appendix K. ^ ' -'ii - : ' ; 

■ [ " ' ' 

^ Although the suB^jects' arid experts * ratings of th^ importance of 
survey items were^similar, sbm^ notable tfffferenees appeared between 
their respdrises. For example, the subjects * ratings oj^ tfe 'importance - 
, of item 83 caused that iterti to be' ranked hin^H iri irSportariee while it 
was ranked as 71st in importance by e|p^rts ..^Subjects i}^ . 
rating of ^i tern '68 was rafiked^as 13th in •iitipdrtarice^. whil^ : 
was r^nke^s 71st in iiiipprtance by>*xp|r^^ (Tfilrg was" a^'three^^^ 
tie-^mqng tJie Sterns rankeii^as^ gf 15 V 

according«?td^ubject raftings, yet, it was ranked 60th' in importance 
by ei 



/^^^^ __• _ ^ L- - ' _ fl . . 

le the format o| the material^appeared to be con 



ns i <ferG«r.an / i m- 

pqXtafSt selection i^ritevion 'by subjects who ranked it 19th', Sxperts' 
did^not consider it^early^.^1niportSit a-. corvsici5ra^|^n as Evidenced*^ 
by theiN<: ranktn^ft 8^^& i-n . i?npprt^ large ^^^^msy^s found 

J ilTem^lKKhich. was i^nktfd as 36th ir^Tfl1portanc|^^ 
le^ed as^-jthe 88th most lmporteni.4 tern on 




i ri"^ *th^i rank in 
s uWe^SLjS i Xe'^be 



the e4oerts'^scal||;-T:Hn^tt^^ orr^hf^h thera w^strconsiderg^te 



va^afti on' between subjec,^ and re>£|ew ptrneV re^onses wal'^m^ 



Hi. 





4 





•1. 



J- 

75 



r TAOCt*IC 

' v,_'... . * _ . . . J- . . 

Survey I tetiti. KeLeiving a Weiyht of 11 




1 tL»m 



Sid H?iy6 n t - >^^^ • ■ ./ 
20 C IvS^-O) n c j s.e , ^ 



. SubjecH « Experts 

Mean _ ' ... M(ean # ^ 

KdnV Aatjn^ s.D. Weight "^ink Rating S.O. Height 




•fni, true ti^ons for 

• 'the stutJent. 

_ . , 4 

Hi!' the suitability of 
the instructional 
1e ve. i to the s tudent . 

- '^^ The conipatibi 1 i ty of 
J Ihf materia 1. wi tfi " 
' itutferits'' iiiental and 
phys ica I abi I'l lies ; 

V 104 The (lecjree to which 
the iiratef i a 1^ dppdars 
to^Qj^itctivafioha^l to 
s tubeqts : ;^ -v;'-:*-^ 

, - as he ; CO n te n I q f _ the^^^ . 
_ * • Ilia te r 1 a 1 . . 3"$ cl e a r 1 y^i. . 'j^^ 
, a hci . y n fie r_"S'ta nd a b 1 y 7 . 
presented. 



9.22 J5I.32 





A focus^on skihs : ^6 
that are ^^efui^apb 
ica^le i'o 
^ t-udept i 

, Mdt^ri*? desT^r^.(i to 7 
. . appeal (g ^ter- 
e>t leve4 bf^*th«. 

' student.* - * 

• _ I - " . _. ._ 

- ' The ia(i?Sr-acy-bf Ih^e 
cbhteiJi^^ t^ ilicirr ■ . 



^^3 The ''eadi.ny.; le^ ^ _ ^ 
; ^ the.iiidierloi.^^n^i' 
_ _ cated by the ^ 

% 64 Ihe objecSvvj 
.'iWtev'al^/e.^i 

1 n^r t rue '(iiirfS^^^6^ 



}/ CHr^jLiei t ■ druj free of 
er-rbr 



97 TtiL' ptfovtsibfi tor, iiiK I? 
lediA^t: feedbJck .to 
^hts. 

--68 The iiiateri:n-is -^el^^W 
siO#a.so thS.t l6*eA. 
trig occurs ..in small, c' 
uni t'I-jjT dchievement. 

3b Ihii jfeljtiui_ish)p be- 1^ 
ty^.'O. e^f fee n .y^rteSS 
><^drtd:the.cust of tfTe. 
: iiuter J a 1 . * 

*^ 3i'ihe attruc ti veness 



- \ ai'd appejl of^Jhe 

■ J_ iiwtecj^ tu y^S"^ 
^tudeiH;iT^>>^ ■ 




4 _ A f c^u t th J t i>^ttiii^ . n . 1^ . *li 

^-^f-^^L luiterei*; <;/-.i»niiki t ) ca 1 ' *~ 



■ .Si-.-- , 



TABLE 16 ^continued) 




6(J Iht iijjter ja4 -dppeurs - 16 
to__fiilfni lis s^t©cJ 
4W>^jplied objectives. 



8:62 " 1.54 1^- . 



^9 The agr^eijiL'nt between 17.5 8.61 l.:55* 11 




^he ntd ten'd 1 and_C|jr- 
r1 cular abject i ves . 



9.20 



.27 IL 



.'^7 The rMateVial is_de- 17.5 8^6? 1.^2 H 'l9. 5^^/' 8. SO • 1.64 11 



2^ ^ ' >^ y Ifc^d . SC> ; thai repe 

^/'a'The forlS^'w^th^ 19. .8 

wb r R bbcA ✓^ttli&Sue • -^vw* ^ 
tape. g-^^M* * 




1 




i 



ni^nt 

15 nateri 

bf^tasR^' that apppar. 
to' Jit of arT^apprbpr|i»^te 
>ehgth:'** / 

73 The pfeserict ,af dTd§^ ^28 ' 8.39. 1.68 " 10 31.3* 8.13 2.19 10, 
^ nostic and prescriptive Vi^ 
V I c e f 6 r * p i a c i ri 9 
fjstodents ^t^ appro^ 
pjrUte entry levels V* 

99 -Tflfe. provision 
:^'}CootinuoQS Jssel?^^ 

."■iiient of stu'de^t pro^^ 

' gress. 



^103 Provision for reF; ^j/^ 
1 e i r n i n_g _ a n d _ re ^fi" 
-asjessmeot in-gt^^ 
: ejJfentipr'po'sC*(!#^t'_iti 



lOlijAfci^vities fa¥<^afla^*ifll r"* 'af.36 1.63 - ^ JO 
^ s^ragE^iort_af tasl?^:. v*^V- % 
master/^re-'ittDpatibtfep^ ' 
with s^dents\.abni>>^' v.^ . 



6 Ev^l^at-ivn 1 tenK_^qp^^ 
• . i i-afcri^ 'with p rd^ani ^ 



32 '-8.32 -«1.75 10 '153 8^67/ 1.44 



^b^a^ves . » * ; 

98 The proviv'on of pre- 33 (s.3i 10 fl^^ 2.75' 

arid pbst-testiacti,*i- - . * 

iety^^f differs .34 8125' 1:55 . ll^ 60.3^ 7.40 2/4^ r S^t 




,1.: 



' • - dnd duV.dbi A »^y^ of the ^jl 
/ .* fw teru I . ' 1 - 

.'J : _ 1 - 




he iiia^ridl . 



teacher' s gui de 



herislve ' V*^"]- 



43 8.20 r.bs . ■ lb 

44 v8. 17 1.88 10 



^''The^ price of. the 

. . * yjBiateria ] ' s con- - . . 

% 3ft*^ •* x*"' ' ^iuniaDle i Ceiiis V 

^^''■■i§t^^ ■'r^ '* 43 The _ot)betXi.ve5 45 

I » - Q^- the. u^dieri a 11;*: , 

M ' r H>&eKthe_sVude!tT;^^'^^^^^^ 

^.'7 _ ■ , : ^ -■ - • ii'^ecti ve, ne^^ . " ^ ' - 

" ^ ■ / " ^i^l^e pSsenc^if ■_ '46' 8.14 
variety _ P^?e- \ ■ 

^ _j whi ch^N:^r 

■ - leal^uig. . . 

; : '</ > ; ' 74 ^Ibfr-^^ci/iV^tion '^ . ': 47' 8.': 
' Jk^ of the prerequisji te ^ ^v.* i. 

skills or readjnes^' ..^ j 
behavij^^^sary ^ , * 
for ipRnti who ^ ^ 
W1I U k»ie>^the ma- 

If not included, §,48 '8.r5^ 2.09 10 

^i-jioWila^>e.;-/or y* ^^T^ 
^ sepa rate"' p:w:&aser 



bdent 



> ' 



sfi^ ■'jps if hot ihc1**d€ 
*- ^ separate Vw:b 



94 Progress eva^ppiifo'n ('-^ 
resufts allpw^for. .'^^ 
direct pLlaoning of * 
t^e: student '-s in- 
^trukti04wl program: 






■i 
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This it|m was ranked 3f 45th in impon;ance receiving;, a wejigfhf of 10 oh;^ 
|^^§^bjeets,' scale. However, th^experts ranked it SOtfi.ih inipbrtahce 

es\ting;to notephe small amount of variation that dcilr- 




iportance^atings of juB^rrCts and e)^perts fpr tttttse^ sur- 

-- -- -- - ----- J - 

a weight of 9, In no instances were the ■a^^e^ence'fT 



a^B^tion occurred^ji the rcKt+ngs of 




the experts' scale greafl|i|^hfn^ \ 
consistently r^ted as more iiipo 
rather ^fiari by experts. This 

Wfcu'le th? iteift.was^ ranked as 81st- in irapo|tance by subjects 
d a height af:'8r experts ^ ;ra |hat*itifti cai^edy^'t to^ , 

rsA in^mpo^tane^l'anct^^recei^ weight q1^4'U 
O^/V^s ra 



e3La&^^B2r^^ by sd and assigned^^j^eight of a. 



the expert pan^V members^ rating of it^m 10 was 97th in Ijn-. 
t was as§igned^a we?^t of Si^iflarly^ 
i^a- 



irhpdPtati 
experts 




was ranked 




a weiiSht'of 8 



e?l i t 100 th i 



spahcy w2i§ fqUrid between expert^" 




ubjects' i/r 




<^:^*P\^^ ratings ^^*em 6. This item was ranked a^Mtfi' in im^rtBmce ^^^^ 
a^^^^igned a^eight of 7 ^ the i>a6^s''of subjects' jr^spdrisis; yet,^s. 



-^bdii^-jbn- ew^ resp^^es it was rank 



i t tq^ be ranked ^as 




s ' ratings^^af th^ impor 




d in i\ 



'^spons< 

IfrtanCe r^e.iving 



l-'bf 'item 49 caused 



with a weight of 7. Xonve'rselyi*^xperts/ indi- 

^ ^ - V ^ ^ . ^ 

ioh Erf lAts impfertance r^^esult^ in that irtem raeceiving a rank of 19 

aihd;,a weight of 10.. , . " 










Survey Items Receiving a Wfri*gtrt 



Stateoient 



Subjects 

^:::>tean . Mean, - - 

(tank Rating S:0: Weight Rank Rating S:0: Ueiotit 




15 Teacher lini? saved- 50.25 7:98 1:97 
through. the use of 
the; naterijaU 

39 The__anpunt_of teacher 50.25 7.98 " 1.78 
InyojyeiTient, required 
♦ for the te toN 
' be u'Sd^rfectfvely^ _ 

41 the Ar^a^nty; ^ v^'^^d.25 Zjg|^1.63 
3"f stUde^t/te"acHe^ 
tn t e r^c^t i o n xe^q u/n'e d ^ 
by the <iti a t &r i a^ ' _ 

7 Z :^he avail abj'j il|y of 
— -Jequipn^nt necessary 
^^^td use thfKtriate rial 
\ (p.g.,^jectdrs,cr 
cassette players). 

v.JZ^The amburi\^f 'dai Vyf- 
^ w^e k 1 ^ >*:$^d t i b ri 
^ ^ ? i t iTfe^ CTre te dch§ c 

'' HiS t-SpeKcl -to^ef- . ./. ^ 
• ^^fe,cxf«^Jy.OS&^^ie I ^ 
1% . * rtw tijri a 1 :• v 

■ ftJo tfie jSills neceiSjKj^ 5^^ 

■ ; t(i ost.Jibe m^felrqfL ]^ 
'1.'. ' i'eifec^fVe^y.arBlGliiK ^ - ^ 
i " 't j)i»tib]e" withl tht__^'_ ^■ 
■ teacher** s.expertj se 



1§ Th'pi^e-gr^tt tp yhi 
^t ;-; it : the__i!>ateriai c 

;■. ;.a;dapted-rt;o^ncet thi 
. schedufiS^tfj^^htf ^cliool' 
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day/year w|tf^iit ajrfect- 
ing jKe raate rial's use- 
ful ness«;-i-' • ■ 

i^^e duratifn of--tinie ' 57.5 7.81: S^<" I 

■^^^^^ired when a^'s'tu- -Y^ ' " ' .:rVN \ 

d^H^^es the miiteH^^ 

The fri?qbezicy of sti 
' de5i.t-^^Pdhse "required 
by the liiateri^al . 

76 Rep la Cerent pieces 
te:g:, lost o^- 
brokeh i te.nis_.- ad- . 
ditiOnal ccJfUiOnents 
,^^tc. ) mayiJbe'.pur- 

chased sepTHy^g^J?* 
nr^TTTe auounf oJi trai n 
■ i ng t i^ie _ D^t* ss a ry ' 
• for the tfacher to 
ef fecti yeT>^-tt« the 
material, . 

78 Supplemental J terns T^fS 
{e_^ g . r P j acemen t tes ts 
vi sual aidsT^di tto mas 
«v ters) accompany in^ the 
' ma teri a 1 . 
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TAULt iU (ci^tihoed) 




62 The pi^sehce of - 
iristructiohal oB- • 
jectives. 

45 Tbeprovlsioh for 
generalization of^ 
knowl?Oge . 

3 The_exjsten_ce_of 
• _d_ preview pol Icy 
wh ic h a 1 .1 ows i n- 
sp^ction of the 
material _pri^ 
to purchase. y . . 

' on^ae lines 'foi;* ?he 
IfuaJnbn of stu- 
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69 
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45 
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73 


2:46, 


7 



65 7.68 1.9Q 



. . evo T uajn o n o f fi tu- j 
j^liht progress. / 
l&^f3?j^^vty with which\ 



'3b 8.14 1.81\ 10 .g 

7.75 7.07 I 3.02 8 
63.5 7,36 1.49 8 , 
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._>.Heafl:_ Mean 
Rank RaljHjg S:D. Weight Rank Rating S.D. Heigtit^* 




Jhe /f>u/Tt)er:_#f<_ -_. ^ r 
s_t|}fte_r>_ts_whp_COT ^. \ _ 
use the material * V^, 
atone time.,. ,r;_'V, - 

^ 44 Tb^ applifatiG^ f ^^^^ -73.^ .%47 2.33 "^j 

of the jikiterial V*y crv 
in other areas V'Xo . > 
; 0^ the curriculum. ^J^^^*^.^ A * 

57 The clVUir/at- '^^sM" l^h^ kk^ 8 
iracti veness . and \_ ^ ' / 

^ ajSprOpriateness of f ■ . ^ - 

i 1 lustrations and/dr — ^' ^ ^ 
phbtbgraphs to the .i. t/^" . 

cbhteht of, the ma- : ' 

- -^Z > 

79 Supplemehta] ma- 7.W^^ 
tefial (e .g: . 
^pl aceittht tests . * 

masters) available 
for sefl^rate pur- ^ 
chdse^^ft^ 

9 Ea;|^^;te ; Ji7 ^^7 .Al 
of the ryterial. 

^^.Jl'i po^"tidt for . >flB 7.39 
^|e br adaptability 
of the iiaterial with 
other than the stated 
population^ ' y 

48 Evidence that'^H^^ ^-V^ 
matierial has be^Yi' ^ ^ ^ 

J revised.^ rid updated 
. ■ regularly: ' . ^ 

t9l ac£omp5^rnig-tOTW-^ 80 
for j^3i*f^a ti 05 : s tu 
pn 

60 1^1 dence that the 
yn^aterial wasAde* 
T ye l oped through _ 
> the use_of_saundt^ : 
re s ea.rch , a n^;^ de.^^_ 
velopment procfeoures. .: \ 

10 fas#wi S. 'whr'c^ -^2 

SMS^_d^th other _ 

^n^"*' ■ -'^^^^ 
2^ '^^^Lc'e ye l oped - 

lis^biHty 
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^>.5 7.36 \ i, 64 B. 
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Survey 1 teog^^j^pi ving a Weight of 7 



6' Freedom, from bias' » ,'84;3 ?^99 "2,^ 
_U.g.. sexist, ' . 
: ,-^racial,_religjoQs}' 
in the material . 

' 5J the ulijj ration of :84.3 6.99 2.12 7 

a specific in- ' " - 

structibnal approach , 

^ 'J^ or method. " j 

jjp^ Provision tor the ' 84. _3 fr.99 2:^8^ 7 





Subject: 



^•nfc Rating ^.D. Welght^^ Rank Rating 



• 9- 
7 . 



^ s tudent t^trick 
"his or her own 



*2 8.40 1-45 

— - ■ .A . - 

• 70 * 7.21 2:fi 

•^54:3 6./^ J 2.52 



^\Vprpgress. . 

49' The 'use pf teach* 87 
• J."9 niethods that 
"are supported by 
eii^ir^c^i evidence. 

6§ A scope and se-' 

qtjehce' ciiart 
. aCcpaJptftTTeT^tfie 
fflaterial: 



is 



6.84' '2.'3I 



• ■ ■ T|t -30 Tbe :dafety feat^jre^' 89 '-^.SS- ''2.92- . 7^ 
I _ V J of ttiir;m5|firial \, : , _^ dLr -t? 

-22 Specifi' 
tiie.tyi^ 
rppm_fo*_ 





Aligned 

.. " t^. teacher trajSni 
■'4t_> mate refills Agco^any 

\-;^^te'the insi^gS^^ ' 
'1^^ V'^mat^fTaU^^.y' 

reebrd i^g lrs 





• 2.23 
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7:43 
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•8.33 


.1.74 




5.07 


2.86 
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6.40 1 
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'."wditliS'uppi 
^--^--^*^^1^the^terial^^ £ "^-^X 



. of thfe»nnateri^> . > ^ 
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" It W|s;. Trite res til^ note that subaects' ratings of itpsiSO 
caused it tp'^^b^^^^ in^ inlpdrtance and i t rece^TVedJ a wpight 

of 4rv/hi1^ tha;t^4ramg item y% ilgnk^d as 23rd in imjw^f'l^^ ancf re- 



ceived a vieight' of rlC^.on .thg* basis^ experts' importance rva.tings. 

Although the rankings bf T^m: 2^ hot differ greatly, the importance 
ratings assigned by sub^^^cts aod experts resultecfin the item receiving 

_ _\ _ _ ; . . . _ ^--^ . . " ^ . 

a weight of 7 on 'the subjects \ scale and^4 on the experts' scal^. 

A similar result dccurred^wi tt> -aubaects * and experts * ratings of 

. . » . . t - . . > . . - } 

item 4. While there was litfele difference in the two groups' respective 



rankings of the^ item - 94th -for subjects and- 99th fdr^,^^perts - subjects' 
importance ratings resulted i.a,'^^^:i of J-^while 



the experts^ rating "of th^ item result^ in it receivG^i^ a^eight of 4.- 



A significant difference wal^'^^hd* between the ratings of sybjects .^ 
and experts on item 47, ^whicn wis as 93rd in importance, by sub- 

l^ontrastifciife. experts assigned it 



je'cts and aTssigngd;^ weight of^ 



14tfr irrnmportance a 




TABLE; 21 
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tABLE 22 

• Survey items R|ceivihg a Weight of 5i4,3,2/l 



I terri 

Statement 



' • " Mean ? 
Rank Rating S.i). Weight Rank Rating iS.D. Wef^ht 



101 : 4.90 
■ « s 
102 ■4/66-- 



I#/3... 



2.35 

2.43 

2.40 



2 
3 



71 The provision ' i99 5.78 ''2.5t 5 

by the pub-iS • 

lisher of in-- ; 
. service training- ' 

80 The preseRce of 190 5.30 
a Useful biblio- 
graphy,^ - 

56 The packaging 
of the ma|er*ial . 

23 The^ type of ' 
. geplrafjliife 
- region prd-^ ' " 
traygd cdriteflt 
of the. ma^tertal . 

cation qf ^ 

the 'jTia'tferigl , -^^ 
^ with bill ngu5\.^ , " • 
flCh^i'Td^en^ --^ ' ^ - ' 

1 ^e ti tle' or . - • 104 "3-.^ • 
product name ^ — v >^ 

of the material : -' , / 




96 5.20 - 2.04^ 



92 5.07 



101 '4.13 



2.. 41 
2.09 



9 
2 



"2. .19^ 1 



102 * 3.77 " 2:19 



2.59 



1: - %^tl03 3.60 



:2m ^ 1^''^. 



SI 



Although no vast difference was'noted in the r^tnkings of item 56^ 

ie/. i 



the subjects' Importance ratings of ' tlie-. i tem resul ted i n;)rfts beiin#\ as- - 



a Weight of 3, whereas the experts' rati ngs' Gau$eU|'4:t.'ito .>ecei vei^' 




a weight of 6r ' 

- % \ 
The preceding, discussion of the diff^re 

expert^ • rating? of, survey items was^Tiot 





Between subje 
^d to dmp;iy that sta- 
?fltical differences bcci^rred between the tv^ set$ of data since it 



and 



ms not the intent to statistically test the differences between" the 
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^Sjen&jar tp describe the 
actuai^practy:es of those who are respcuisibte fo selecting instruct! 
raaterfals^or students receiving edUcatipn services. 

Intended Use of the Checklist ' ' ■ 



The purpose of developing a weighted checklist was to provide indi- 
viduals selecting instructional materials a basis for cdmparirig materials 

tinder coTisideratioa. Ideally, a person would rate t*1e presence of each 

■ ■ _* ' _ * > ' . ' • . .. 

criterion on a scale from 1 (low) to 10 (high) in the same manner' as 

i^tems containe^"^ in the sdrv^^ .were rated. The rating, assigned to: each • 

criterion wou'llithen be multiplied by thi correspoTiding; weight; Finally,^ 

the r^uTtirig scores- for each selection '^criterion would be added to pro-' 

' ^- r. :^'^-^^' ■ . . • ' ■ ^ ■ \: " ■ 

duce the dveralT ratin§ for the material. An abbreviated, exampl e of ^the ; * 



intended fiih^gt'i^ of. tfje ehecklist is pr^eated in Table ;^3/ ' The. com-, 

pl^te weighted eheeklist prbtbtyce_ls ^fentairied in" Appendix U,' 

' ' ^ TABLE 23" ^ — . . 

'^i - , - - '■ - ■ . ' . ■ 

Sample Rating of an InstructibnaT ^M^teri a1 v ' * 



rial X - - ■ ■ y 

;■ _ _ , _ 

^ i. .The accuracy oT the content ^f the material. ' " 

1^.2^ 3 4'. 5 6 lid) 9^10 - (x ■ 1!) 
'2. The i^sicaT quality and durability of the material. 
- . 1-2 3 .4 5 @ 7. 9 '9 10 , (x 16) 

3. Evidence that the material has Beei^updated .regularly , 
" .1. ' 2'V '3 4" 5''5 7 "8 (5*10 

4. Pa'tk.ag-i ng ofiith^ material . 
2 # 6 6 7 8 9 id. . (x 3) 

5. : Hhe ppy\^ioh by,the publisher of in-service training., 
1. 3" 4^ 5 6 0). 8 *-.9 10 (x 'sr 
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Based on the above procedure, the 'sarnpl e'- mate rial used in Table 23 ■ 

would receive a ratir>g of 270. A racing system of this typq would 

provide the individual .choosing among several similar materials a 

basis for comparison. - > 

Additional Selectioa Criteria Ider ^tvfied by Subjects 

Space at the end of the surrvey allowed subjects to add and rate 

the importance of any selection criteria which they felt were hot 

iheloded in the survey. One hundred thirty-five (135)^ or 12% of 

the subjects, listed from one to five addit^cmal criteria. ^Sbme of 

these iterr^ were identical or similar to items already cdnfained in 

the survey. In all, subjects identified 273 additional selection 

' criteria. (See Appendix M for, a complete listii^. 

Subjects' Cbmmerits about the Selection of^Jnstructional Materials 

A blank page at the end of the survey provided subjects an oppor- 

tunity to add cdntnents about the process of selecting instructional 

inaterials. OPte hundred eighty-nine (189), or 18% of the survey re- 

_ __ _ i ^ 

spdndents completed this section of the survey. Each of their comments 

was read and tallied according to arga of concern. 'A tabulation of the 

areas of concern reported by the^ubjefets is eohtaihed in Appendix N., 

Jtequests f6r Results of the Survey 

In response to the oppdrtunity to receive copies of the results 

of the study, 12 df the panel members^ 272 local dir^ors, and 715 

subjects requested a cdpy df the ^results of *the study. 

/ 



88 

* - Summary ' ^ 

'In the course of the present investigation a national sample of 
individuals who select -^instructional materials for special educatian 
students was surveyed for th^ purpose of ^d§ternT^irii rig th? amount of 
importance^ assigned to materials selection criteria previously identi- 
fied in the literature.^ Demographic 'iriformatidrv was solicited from 
survey respondents for ttje puri^ose,pf descfi|)ing the sample population 
and to provide a base of information for^ future, resear^ch iri the area 
of instructional materials selection. Subjects* responses to a 104^ 
item research survey were used in th^e developmient of a , weighted se- 
lection checklist prototype. ' 
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' ^ ■. EHAPTER V ; 

SUMMARY ANB.REEeMMENDATieNS ' . 

.This chapter will provide a sumTiarization of the purpose and 
methodology itiVdlved in the present research. The results obtained, 
comparisons with previous studies, and recorSnendations and implications 

for future research will also be presented. 

t, • - 

• . \ . • 



Summary 



The primary objective of^the study was to develop a^weighted 



checklist designed for use .in selectifig^ instructional materials for 
h^ahdicapped students. Selection criteria identified by 24 authors 
were reviewed |rtd consolidated into a ld3- intern- field- test survey. 
The field- test survey was reviewed by a l5-membe^ review paheT and 
TOdified in accordance with their recommendations' . State and local 
directors of special education programs wene a^ked to assist in the 
identification of a riatibrial sample of individuals responsible for 



selecting instructidhal materials for special education students. A 
104-1 tern research survey was sent to K59 subjects identified by local 
directors of special education programs. Subjects were asked to indi- 
cate on a scale Vrom 1 (low) tp 10 (high) the amount of importance they 
assign to the identified cri'tferia for materials selection wHen ehoos^'ng 
instructional materials for students receivifig sjDecifal education serv-' 
ices. A mean importance rating and standard deviation was calculated 
for each survey item. Survey items were r4nk-drdered frbrtf most to 
least! important and proportionate scale weights based on mgaris (Edwards, 
1957) were assigned to each survey Item in order to. c^ea^e a weighted 
■ . 89 ^ ^ ... V 



instructional materials checklist^, informatibh was sol icited from 

survey respondents to provide a basis for an analysis and discussion 

of the following questions: ' ' • , • ; : 

" . ' ! 

1. What were thfe mean importance ratings assigned to 

iderttified selection criteria by subjects'? - 

— _ _ , _ _ ' _ I . ^ - - - - I 

2. What were thf mean impdrtarice ratings assigned to ' 

/ . ; / ^ • ... * ^ ^ 

/ identified selection criteria by e>^pert revieVJers? 

3. What is 'the correlation between mean •importahce ' ^ ; 
ratings assigned to selection criteria by. subjects . ^ > 

and expert reviewers? * * : ' 

•I , . 

4. For what types of. s'ltudents did subjects report 
\ • _ / * - • . 

\ selecting instr^iptional materials?' 

- 5. What percentage! of survey respondents select 

- - \-- \ y > ; 

materials for elementary- age students, secondary 

age stud'^nts, or both age groups? • . 

6. What positions in school districts or cobperatives 
are held by individuals who are responsible for 

. /sele.cting instructional material^? ' . 

7. . What percentage of individuals who select\^structional 

-materials for- special education students report having 
' - ' received formal coursewbrk or training in this area? 
^. What- percentage of subject^ indicated that they felt 

fSrmSl coursewbrk or training in the selection of 

instructibnal materials' is bf value? 
« 9. What sources- did subjects report using to obtain 

_ . _ ' / _ _ . _ _ 

informatibh abpUt iristrUctibnal materials? 
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Id. What* percentage of indi viduais who ^lect instrUctijhal 
materials report usirig a check! ist^r materials seleetioh 
^ form when making sellectioji deciiidris? " „ 
11. in wl((at s&tjings are the Ing'tK^Uctidnal materials 'Selected^ 

By subjects used? . 
Respondents' demographic information was coded and t>leir ratings 
of the importance of identified selection, criteria was analyzed by 
means of a computer. - . • ' 

Results ^ ^ : ' ' 

., ^ ' ■ 

The majority of i n^i viduais surveyed w^re found 'to be selecting 
materials for either educable mentally retarded or learning disabled 
students. - The next largest student group for whom materials are se- 
lected '•was^ the enxDtionally disturbed, these reports coincide with ' 
vhatibhal ^nel^hee figures by being the^three cat^ories of excep- ^ 
tidriality whiN:h represent the majority of students receiving special 
education services. Fifty-six percent of thg subjects reported that 
they are chods.ing instructTbhal materials for two to fiVe or more 
types of ^jJceptidnal st^Jdents. Of that group, the majority select 
jnatena for two or three types of exceptional i ties . It is likely' 
that the individuals whd select rnaterials for two or three types. of 



students provide services in crdss-categdrical programs. 

Subjects' responses were fairly evejiiy^i vided ambngy:he possible 
agj groups of stud_en^s for whom materia'ls are selected. Slightly more 
than one- third i^ndicatejl that they select'materials fdr elementary- age 
Students, while approximately another one- third choose materials for* 
secondary level stuS'ents; slightly less than one- third reported b§ing 
responsible for selecting materials for both groups. Nearly half 
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/{A7AQ%) of the respbridents indicated that they employed as re- 
source room teachers. The next largest group of subjects consisted 
of individuals who hd*ld stapervisary' p^ ih their respective ' 



districts^ while the thir|J .largest subject group (21.31%) indicated 

_ ^ - _ - fir - ^- - -- __ - 

that they are working as self-'Con^^^ed classroom teachers. Remaining . 

* - . * > 

^ respdndents reported that they are-either itinerant teachers, princi- 

palSi» or diK^ctors/of special education. Ten percent of survey par- ; 

' _ _ * 

^ ticipants indicated that they serve iti two positions in their .respective 

school districts. ' 

Subjects were also asked if they had- completed formal coursework 
or training to prepare thenytd select instructional materials for spe- 
cial education students, ftore than half (60.62%) rfefspbhded in. the : 
affirmative- to^this question. Thirty-eight percent indicated th^t ' 
they had not received such training or cdursewgrk. _ ^ 

In addition, sMbjects were asked^ whether dr hdt they cp;nsidered 

such training be of value. The vast majdrity (85.7^8%) indicated that 

• ' _ _ ■ - * - 

they regarded training in the selection of materials as being. val uable. 

Regarding the sources use^d. to obtain Informatiori abdut instruc- 

; r 

tional materials, responses were fairly evenly divided among the pds- 

. - ^_ " . 

sible chaieefe. T*ublishers * catalogs were mentioned most frequently, 

^ while the ad\/'iee of colleagues emerged as ^he second most frequeTitly 

listed choice. These two sources made 4)p over 40 percent of the total 

response to this question. The third most frequeritly mentiQned resource 

included materlalsudispl ays at conferences', followed closely by profe.i^ 

sional journals and inservice meetings, fn^the space provided for liJi- 

ing additional sources and the exact 'nature of such sources , .publ ishers * 

representatives 5 tmi^?ersi ty/personnel , ani^ 'col'lege coursework' appeared • - 

.roost frequently., 1 

■ ■ ■ iei ' ■ - ^ 
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The subjects w<^rej.lsb queried abbtit the frequency with "which thgy 
>use chfckTists when seleetirig instf-actional iaterials. Most responses 
(88%) were .nearly evenly divided among the categories "occasiffinaTly" ; " 
or "never". A small percentage (7.68%) of the re'spondents sfat^d 
that they always' use a ehecRlist to select materials. 

•In response to a question regarding thl settings fpr which sub--'- - 

I <i r - u 

_ _ - - '■ • _v ■ ' 

jects select materials, 42 percent responded tha-t the selebtetl materials 
are used in their own classroom., Thirty peVcent reported that they se- 

w y ■ 

. Tect materials for .use in' ttie classrooms of bthers': Nearly 20 percent 

replied that th.ey select materials for* usf^ in\chool district libraries 

or materials centers. Remaining subjects indicated that they select 

• ' • ' 

materials for use in other IdcaticSris. ^ 

Weights were assisned to each survey item based upon the mean 
importance rating awarded#y subjects. A survey item'could be weighted 
from 1 (low) to 11 (high)/ Subject ratings of the survey items re- 
vealed that 69 percent of the survey content was assigned weights of 
either 11, 10, or 9. In contrast, only 8 percent ^f the survey's con- 
tent received weights of 6^ or less. These results offer evSdeftce to 
support the nation that the majority of the identified selection; cri^^ 
teria^were considered important by those who selectJnstrf^ctiohal ma- *. 
ten als. ^ • . . 

- ._ * V 

, The'' review panel's ratingrcrf survey items were found to be similar 
to those obtained from th# subjects^ Thus, 53 percent of the items were 
assigned weights ranging from 11 to 9, with 13.5% recl^iving weights from_- 
1 to 6. " 
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Further evidence of the sirnilari ty-^betweeh subjects' and experts 
ratings of the survey items is reflbctec| >n the strong positive eorre- 
Tation between subjects ' and experts* reSponsesV^'.e. +.81. 

Although the slibjects* and experts' ratings of the importance of 
survey items were similar, s^me notable differences between their re- 
sponses were^^^^^d^d. The following" is a listing of those^rvey items 
for which there was considerable variation between the importance rat- 
ings of the two groups. j • 

« _ * ■ 

^ 1; The reading level of the materi'alHs indicated by ^ 

the 'publisher. - . . ^ . ^ 

2. The mptferial is designed so that learning occurs 

ifKsmall units of achievfemeRt. ' 
3* The attractiveness and appeal oT the material to 
^students. % 

4. The fbrmat of the material (e.g., workbook, cassette 
t^pe* gamci etfe. ) . , 

5. Number of times- the material would be used by a student.* 
.6. Objectives of the materia^eet - students ' affective npeds. 

7. Evidence that the material wSs developed through'the use 
of sound research and developrriejat procedures. 
^ 8. Ease with which the material may be^ shared with other 

teachers . ix 

..- _ _ __ . _ _ » ._ 

9. Material developed for Use with a particular disability 

group. J ^ . 

• Id. ^ Freedom from bias (e.g.^ sexist/l racial, religidus) in 
• the material . . 
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,11. Teaching ipethods^supported by'empiricgl evidefice. 

12. Safety features of the material '/ * - . ' • 

13. • Specifi cations of the type of classn^iriv * ' . 

the materifl was designed; . *^ 

_ • •_ ■ 

14., the ppyright or publiea-tion date; - , ^ ^ . ' 
' ^ 15, Provision by the publisher of field tes_t^data which 
support the effectiveness of the material. 

Y 16. The packaging of the material. - - * . . 

^ . ' _ _ ' * . ■ :\ * : 4^ 

There are a number of reasons why eaeli group may have had dissimi- 

lar perceptions of the importance of certain cri terion ^tatemenfts . Th* ^ 

experts, as a result W their experience tin deseriblnO the materiatB 

sel^ftion process in global terms^ may have responded to thq survey 

frqm a^global framework.' In contrast^t the ^subjects are likely to have 

based their responses on actual practices; of selecting materials. Sue^r 

a difference in perspective may exp.lain why subjects attached more irri- 

; porta^ce to the items deal i/ig with the format of the material-, the num- ' * 

..... ._ . . . .. >. .. 

ber of times the material would be used by a student* the attractiveness 

and appeal of the mateVial to students, material developed for use with 

. . 

a particular disability group, ease with ^hich the. material may be 

N _ '_ _____ . * - . _ 

shared with otber teachersT and the specification <)f the type of class- 
room for. which the material was desighed, \ • 

The emphasis in college rou'^^ework on determining the readabil i ty 
level Sf instructional materials may adcount for the importance assigned-' 
by au^'eets to reading'' level. In contras't,' the experts may £fe more aware ^ 
that estimates pf readability can vary dependent upon the formula used; 
'^thus, they did not consider readability informatiori to be as important 
a selection consideration. ^ ' . 
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_ A similar exprlanatlon may be proposed for" the imjDbrtahee ascribed 
by. subjects to the item worded "materials designed so that learning 
occurs in small units of achievement*'. Frequently, teacher training 
- 1ji special education emphasizes the need for task analysis of units 

of instructi^ojp^ Thus, the subjects* Importance rating may reflect ^ • 
- "their trailing in breaking down units oT Ins tructidn into component- 
parts. The-experts, however, may have interpreted this criteridh 
statement as advocating that materials place limits or) Jhe pace at 
which a student progresses through a given program. 

^ The expert grqpp consistently irated survey items spetifyirigjthat 

materials should be tTaseti upon sound research evidence as more Tmpor- 
tant than did the subjects. Th>s position is to be expected from a 
group of experts, many Of whom are associated with colleges or uni- 

- ^ versities. Practi tibners , on,^the other hand, especially if they have 

not received traihihg^in materials selection^ may not be aware that 

materials should be designed oh the basis of sound research and de-V 

. . _ ^ _ \ _ __ _ _^__c 

veldpmeht procedures. In addition, publHsShers seldom provide evidence 

I ^ _ • _ 

Vdf field testing or empirical support for materials, it would not be 

. . I " - 

surprisirig to fiJid tf*^ subjects were unaware that such information 

should be made^*avai lalle by publishers. 

Greater fami 1 iari ty wi th the History of''* the -efforts to allevtat^ 

biases in instructidnal mcfterial may have led the expert panel members 

.tojattach nxire. impdrtahce to the survey item related to this topic. 

Since most instructidnal materials used in the classroom are of 

a print nature, the item pertai hin^-td safety features was not likely 

to seem relevaiit td the practi tidhers- Oh the contrary, if the experts 
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were considering the entire range Of avallabtle material "formats , they 
•^obld be more inclined to view the safety, features of a material as an 
important selection cons'lderation. - - - ^ 

Ironically, subjects rated the packagihg of Iristruetional materials 
of lesser importance than did the expei^ts. Individuals who are respoQ-^ 

sible for selecting instructional materials are frequently criticized 

— ___ _ * _ 

for attending to the packaging rather than the content of tfie instruc- 
tional product. Several members of the review panel areT or previously 
have been, associated wi th sconinerclal publishing 'companies . Since pro- 
duct marketing often emphasizes packaging. It is conceivable that their 
response to this item reflected such ^an emphasis.. ^• 

When ritfng the importance qf the copyright or publication d^te . * 
df a material, sub jectsj^may have ac^ed from the notion that "hewer is 
Jettef\ . ^ . ^ ^ 

It-Tis not known wha^effect training in the selection of instruc- - 
tionaVrnaterials had Spon subjects' ratings of the survey items. It 
Should be noted that 38 pereant of the^sample population had not re- 
ceived training. This may acco'unt|for the variation Beto^een responses 
of subjects and experts on certain survey T^ems. • 

vTfee discussion of the differences between subjects* and experts' 
respojises was not meant to ihiply that the responses of one group were 
inheretitly more or less correct than those of the other. Since the 
^ ' bulk of existing literature on the selection of i hs tructiohal materials 

has-been formal a ted on the basis of iuthor opinion rather than a data 
baser; the present research represents the development ofia data base 
conce^.h^ng actual practices among those who are responsible for se-^, 
lectin^ instructional materials. ' * 
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The data obtained in the ^present Investigation were similar to 
those repor,ted by Komoski T1979) based on a study cdhdUctec^by the 
>^ Educational Products Information Exchange (ERIE). According to ERIE' 
figures 55 percent of the ind1vidua3s surveyed l^eported that they se- . 
leet tW materials used most often in their claprooms. The grdUp 
described by Konbski^ consisted of regular classroom teachers. Thus* • 
'he theorized that the ERIE results were more representative of the 
practices of regular classroom teachers than special educators.^ Yet* 
the data obtained in the present investigation of special education 
practitioners suggest that, only 42 percent of the individuals surveyed 
are responsible for selecting' the materials used in thS^ir'own class- 



roorps , 



The data obtained here contrast sharply with Dorrna^*s (1979)' 
statement that "neither teacher**s nor teacher trainers have considered 
the selection of instructional materials to be a^ hi^h priori ty training 
^ed*' (p. 28), Those surveyed in the- present study strongly {8§%) in- 
dicated that training in the process of selecting instructional materials 
y^is of value. ^ 

The results of the pt^esent investigation also differ from those 

• / _ ; _ _ _ 5 _ ^ 

reported by Latham (1974) indicating that only 27 percent of the 'in- 
formation on materials evaluation fbrms is of interest to teach,ers. 
An examination of the distribution of subjects' importance ratings 

.t^ survey items revealed, that 69 percent of the survey items (those 

- -- --- - " - ■ ■ 

^ weighted 9, 10* or Mi werf considered as being most important by 

V 

those responsible for selecting instructiona ^materials . 

1 ■ . ^ ' 
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Subjects* ratings^? the importance of .selectidri criteria ideriti- • 
fied in the present research are in direct oppositidh to KbmbsRi's 
(1979) statement "that teachers continue to be influenced by the in- 
structional ly less essential characteristics of materials such as 
packaging, prestige of author or developer, and, of course, the new 
approach to content" (p. '202). While the surveyed populatidn'was not 
composed entirely of teachers, Komoski's appraisal is not supported 
by the data from the present study. Survey items pertaining td the 
packagHiig of . a materia/ and author prestige were among thdse receiving :* 
the Idwelst importance ratings. ' Furthermore, although no survey item 
specifically addressed. new approaches to content, items examining var- 
ious aspects of content were included among those rated highest in 
impdrtarice by subjects. 

The results reported by Levine (1959) indicated that the evaluation 
criteria most frequently mentidned by participants in an evaluation in- 
stitute were "cdst df material, whether it can be used individually or 
in groups, the type df child it can be used withi and whether it con-4^^ 
tains student appeal" (p. 6). Applied to the results of the present 
investigation, dnly dne df thdse criteria, "whether it contains student 
appeal" would have fallen among the survey items assigned; a weight: of 11. 

' the informatidn gathered in the present investigation provided the 
necessary data for develdping a materials selection checklist which is 

. ._ . .. .a _ _ 

weighted to reflect the levels of impdrtance that Users df instructional 
materials apply to selection criteria previously identified in the li'ter 
ature: Furthermore, the findings point td the necessity qf Using sdme f.^ 
type of instrument in the selection and evaluation process. Th1s/<ieed 
is evidenced by the fact that while the subjects indic-ated that ajl many 
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as 12 items are considered to be 0? most iiiiportahcei only 7 percent 
reported consistent use of any type of checklist. To assure consistent 
applicaticm of such a large number of variables the use of a weighted 
checklist is critical; Suggestions for potential uses and applications 
of the weighted checklist, as well as topics for further research of 
the prototype instrument are made in subsequent sectidhs. 

Suggested Use of the Weighted Eheckli^t 

The checklist can 5e utilized by individuals who are interested 

in appraising instructional materials in^a number of ways. For example^ 

the entire checklist (Appendix L) may be used^by somebody who wishes to 

compare materials on the basis of all the criteria identified in the 

present investigation; Qn the other hand, individuals teaching others 

the theory of how to select materials may wish to highligfjt the criteria 

rated as^rrost important by expert reviewers (Appendix K). Finally, the 

criteria rated highest by subjects may be of more interest to those who 

actually select materials for a given population of students; 

Using or^^y a part of the checklist may more readily meet the needs 

of others. Thus, ah individual may want to rate a given material based 

only on the selection criteria which received the highest weights; The 

checklist could also be Used by developers of instructional materials 

'as'a set of guidelines reflecting the cbmpphents of materials judged to 

be most important by consumers. Fi hal ly, th^ weights may be appTieS ?s,. ; 

a collection of points to consider when selecting materials, rather -than 

as a rating instrument. • : 

The proposed checklist can easily be converted ti> a micrbcpmputer 

. • . 

program. Such an adaptation would permit the user tS. quickly rate the 




material under consideration and thus avoid haying to perform the * 
necessary mathematical operations by hand. The conversion would also 
make it possible for the user to store and quickly retrieve infdrmatidh 

^ , : . 

about a ma^terial after its initial evaluation. 

Recommendatidns and Implications for Future Research 

The data collected in the course of the present research provide 
a base from which many additional research studies may be conducted. : 
Thus, future research needs to address the areas outlined below. 

1. No provision for measuring the reliability of subjects' 
and experts' responses was actually incorporated into 
the design of the presen*t study. Therefore, future 
research should address if subjects* and experts' 
ratings of the importahee of survey items would change 
with the passage of time. It is of additional interest 
to determine if recent decreases in budgetary allocations 
would have altered subjects* opinions of the cost re- 
lated features of instructional materials, 

2. Rankings in the preset investigatibh were assigned based 
upon subjects' and experts' mean ratings of the importance 
o^:surVey items. It is of interest to determine whether 
those rankings would be comparable if each group had been 
asked to rank the survey items in order of importance. 

3. There is a need tp investigate whether or not all of the 
^ criteria^ identified in the present research are present 

in instructional materials, or whether only^ certain'df 

them tend tif' be common to most* available materials. It ' 
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is Unknown criteria previoufljTi^eriWf ied in the 
literature were an indication of elements thafr should 
be pWsent versus those that coiponly present. 

4, Future research must determine if those who select 
materials would actually^ use a checklist that yielded , 
numerical ratings. Only 7.68 percent of. those surveyed 
in- the present investigation replied they always .use a 
checklist when selecting instructional materials. There- 
fore, it would be of interest to ascertain if the pro- 
vision of a checklist that providerd a means of quanti- 
tatively comparing materials would increase the checklist's 

-Usage. 

5. While the purpose of the present investigation was to 
develop a weighted checklist prototype^ how a need exists 
for further research to evaluate the effectiveness of this 
checklist. Specifically, (a) will the appl icatibn- of a 
weighted chec*>list enhance the material selection process? 
(b) will materials receiving the highest ratings prove to 
be the most effective in actual classroom use? i 

5. Potential differences in response to survey items based 
upon the type of student for whom materials are selected 
also need to be addressed." Results of a study of this 
nature could provide an answer to the question of whether 
or not the criteria for selecting materials tend to be 
common across categories of exceptionality or whether the 
selection process is exceptionality specific. Specifically, 
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it wQuld be usefuT to detennine whether, there are > 
differences in the responses of those who select 
material fdr st^ents with learning versus* sensbri al 
handicaps. Th^at is, are the criteria most important ; 
in the selection of instructional materials the kame 
achDss categories or exceptional ity? Or is it possible 
that those criteria are disability-specific. In this 
connection, implications for teacher, training should 
not be dverldbked. 
7. A ""similar type of research study could be conducted, 
using the age of students as a dependent variable. 
1 1 i's possible that a re-exami nation of the data, ^ 
generated in the course of the^re'sent investigation 
would reveal that the crit^ia deemed most important 
by those who choose materials for elementary-age stu- 
dents are significantly different from those considered 
to be important by individuals selecting materials for 
older students . . 
8. While the positions held by survey respdhdehts were 
ideYitified, individual responses were not analyzed oh 
the basis of this variable. /jfelditiQnal research could 
be conducted to determine whether the criteria seen as 
TOst important by individuals who are teachers ^ for 
example, are viewed significantly differently by those 
who hold supervisory or administrative positions. 
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9. The^re is a heed "to evaluate the effectiveness oi^ the 
~~ ' checklist as a training tool. Such *an evaluation 
\ might i^lucle determining: -dtility for training 
individuals to select and evalaate materials; and 
use df the checklist in preparing individuals to 
becone rrore informed consumers of educational pro- 
ducts . ^ * 
Id. The effects of training in the area of materials ^ 
selection also represents a research need. *For 
\^ " example, does training in instructional materials 
\ ^ selection result in a significant variation in the 

• criteria rated as most impdrtarit by survey respondents?- 
As a result of training, individuals may have become 

more aware of ttie criteria upon which to base selection 

' _._ . _ __ _ _ _'. 

decisions and, in turn, rate the impdrtahce of those 

criteria higher than persons without specific materials 
/ ' selection training. 



11. The types of materials to be selected with the help 
of a checklist also need to be identified. Givpn the 
vast array of available materials, it is inconceivable 
, . that individuals responsible for materials selection^ / 
have ah opportunity to perform an indepth analysis of 
each material selected or purchased. Therefore, an 
identification of those selection criteria most germane 
to the material formats eurrenkly on the market would 



be helpful. It would be useful,' for example, to. know 
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^which selection criteria refl^ect the most^ ifnport^nt 
points to be considere'd when selecting print texts 
versus supplementary activity k-^ts. 



12. Since subjects and experts may have rated certain ^ 
criteria differently based upon 'varying perception 
of the meaning of individual; sur.vey items, it may 
• be necessary to develop a checklist which includes 
a definitfon of terms to ensure consistency. ^ . • 
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THE UNIVERSITY OF KANSAS 

Depaftrnent of Special Education 

Cpllegc of Health Sciences and Hospital 

S9th and Rainbow Blvd., Kansas City, Kansas 66103 
^913) 588-5944 
(913) 588-5943 

^ 



I am currently eonduetihg a research study funded by a grant from the 
Bureau of Education for the Handicapped^ This study is designed to 
develop a model process for selection of instructional materials for 
handicapped students^ As part of this process it is necessary to 
identify the criteria currently jised in the selection of instructional 
materials^ The results of^infonnation will be used in the development 
of a weighted selection checklist. - 

^ ■ * 

The ^questionnaire to persons throughout the Unite.d States 

who have the responsibility for selecting instructional materials for 
elementary and secondary special education students. Prior to the 
circulation of the questionnaire, it is important to obtain the eval- 
uation results of expert evaluators, . 

: Because of\your work in the area of se'Tecting a.nd evaluating instruc- ; 
. tional materi\als for the handlcappe as a 

^professional who could serve as an expert eval uator. If you would be 
' willing to serve in this capacity, the questionnaire is iticluded,. The. 
questionnaire lists the' cri teria one can use ih selecting j^gsjtructiona 
materials for the handicapped. I would appreciate it if yb^Twou Id ex- 
amine each identifiecl selection criteridh and fate* oh a scale bfl to 
10, the amount of importarii^you attach to each criterion when .selecting 
instructional materials. Space has been provided at the end of the 
questionnaire for you to 1/lst and rate addi tidhal . cri teria that you feel 
were not listed on £he printed, questidnhal I wouTdiapp'^ec^ 
V ' ;. ceiving the completed. questlDrrnaire by February 16^ 1981 . A stamped 
self-addressed envelope has been enclosed for your cdnveniehce. 

Your participation inthe study is voluntary and all responses will be 
kept confidential . ' Although your participatioh in the study is fdr the 
verificatidn of questionnaire items I would welcome any additional com- 
ments ydu may have. If ybu have any questions about the study please 
phdhe me 3t the number. 1 is ted abovfe. A copy of the survey results will 
be s^ht to you if you list your-hame and address at the bottom of the 
survey. , ^ : 

lis ;. 

, - ^^„,--^-" 124 ' . 

■ ■ ■ ' • • : • 

.* _ ._ _ Main Cainpus, Lawro , _ 

Q - Cbiieg^ of Heaith Sciencers and Hbspitai, Kansas City euid Wichita 
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•Thank yd U for your assistance in this research project. 
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Mc«iC rate the AMMmt l««K>rUncc «tucti'te r^rti •f'^the fo1li««t(«o crltc^u w*«rf( kclrctln^ iMtr^tlotuI 
t* 10. fiMM circle sMl/ nu^cr Uc«i ani refrain frDM.#0difi9 fractiural or «rciaul poUti mm the Kale. 
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TH;e UNIVERSITY OF KANSAS 

■■' ' / '''..■'i- „«^:-' ^'Sj-^ : - . , - 

_ i>c5artiriint of Special Educatiori . r ^ 

CoUege of Health Sciences and fjospita] 

39th and Rainbow Bivd: ^Kansas City, Kansas 66 103 
(913)588-5944 
(913) 588-5943 



September 37, 1980 



I am wHting to request your assis in a BEH research study*;deal ing 

with thre selectrpn of l^truetionaT materials for the handicapped. The 
purp6seic)f^ the .study is tbdfevelop specific sel^ctton criteria on which 
the Ghdice' of iristructibrial materials for .handicapped' students may be 
basecfr> , . ' . _ ^ . . 



In order for the re^u3ts of the study to be valid and reliable a nation- 
wide sample of subjects will be surveyed. The subjects of the study will 
be irudividuals responsible for selecting instructional materials for 
handicapped students.,:<the i^nitial step in the process of subject selec- 
tion requires.the identific||ion of Directors of Special Education in 
your stat^^ I would appreciate your cQfi^eratipnjn providing a list Of 
the names arid addresses of these individuals s6 that I may contact them 
regarding th^ ideri^tif ieation of subjects^ It would be most helpful if 
this l-i^t were forwarded to me no later than October 1, 1980 . A stajnped 
sej f-addressed envelope has been endose^for youc convenience. 



questions regarding the study may be sent to rrje in- care .ff the above 
address . * 



Thank you for your assistance in this project 




Mary Ventura 
Project Coordinatdr 
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THE UNIVERSITY CT^ KANSAS 



':. _ P_ei>artment of Special Education 
College of Health Sciences and Hospital 
39th and Rainbow Blvd., Kansas City, Kansas 66103 

(9 13)588-5 944 

(913) 588-5943 




I am Currently conducting a research study funded^ by a grant from the 
Bureau of Education for the Handicapped. The study is designed to 
develop amodgl processfor selection of instructional materials for 
handicapped students. As a part of this process it is;necessary to 
identify the.cri ten" a currently used in the selection of instructional 
materials. The results of this information will be used in the develop- 
ment of a weighted selection checklist. Approximately 3,000 individuals 
who are responsible for choosing instructional materials for handicapped 
students will receive the research questionnaire. In the context of ,v 
this study^ handicapped refers to students who are r-eceiving special 
education services. 



As a special education administrator, it is likely that you know the 
individuals, in your scihool district who a^e responsible for selec^ting 
the materials used by handicapped students^ Therefore, I would appreci 
ate it if you would 1 is t the . names and addresses of three individuals 
who select materials for elemental ase students and three who, select 
materials for secondary age studertts. These individuals could be class- 
rodm teachers, resource teachers^ curriculum coordinators, consul tahts/ 
or instructional materials center personnel . If you do not have access 
to the information being requested, I would appreciate it if you would 
forward this letter to the persbh in your district who could provide 
the names. _A research survey will be sent to each of the individuals 
you frame. The survey will take about 10 minutes to complete. I would 
appreciate receiving the list of names, no 1 ater than January 19, 1981 . 
A stamped self-addressed envelope has been enclosed for your, cpnve-nience. 
Fdr.eyery 150 names and addressed received by the. above date , I will send 
a $5.00 contribution to the Foundation for Exceptional Children., a non- 
profit organization established by the Council for Exceptional Children. 
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i Main Cji-ih pus, Lawrence * 
College bt Health ^oiehbes and Hbipital, Kanaaa City and Wichita 



Your participation in the study is voluntary ^eind all respons be 
kept confidential . The number that appears at t^^ top of the list of 
names and addresses will be used only for record keeping purposes. Any 
questions about the study may b listed above, 

if you would like to receive a cop^of the results please place- 

an X^in the box at the bottpjn of t^^ • If you choose not 

tx) parti ci pa, te in the study" would yeu place an X in the appropriate box 
on the enclosed sheet .and return it to me. 



Thank you for -.your assistance in this research project. 
Sincerely," ' 




Hary Ventura 
Project Gbofdihator 
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APPENDIX^ 



r Fdrm for Recording ^he.. Names' 
^ and Addresses of Subjects 
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Three indivi duals who select iHstruetional materials for e1ejiiervfeir:»;aqe 
handicapped studgnts: ~ 

i. Name ■ • ' " ' > ' ' ^ 



. • Address 




















2. ; Name 


City 


State 


i Zip , 

1 




'■■•* Address ' ' 




3. Name 


ei ty 


State 


Zip. 





Address 



pity f . : State Zdp 

Three individuals who select instri^tidh Jiiaterials for secondary 



students : 
I. 





Address 













City , 


^tate 


Zip. • 


2. ' Name 








, f- . ■ 
















City 


..■ State 


Zip 


.3'/ Name 






■ i : ■ ' . - - 


Address 


s • 


--4^ _^ ' 


.. . . ^ 








. r ' . 


••^ / 


City 


State 


Zip . ' , 


9 Please send a copy of the stu< 


iy results tb> 


■■ - 



0 bo not choose. to participate. 
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In order to develop d weighted materials 
setectidh* checklist^ it is necessdry to 
know the criteria thdt ore uv^d by tKdse 
who select instructidhdl rtidleridls fdr 
handicopped SLtodents: Therefore^ your 
responses ore important: 

_ _ i 
pirectidhs: 

1. Please cqrnpfete the inforrnotion 
requested on pdge one of this 
bddklet. 

. * _ _ ' ._ _ 

2: Exomine the f riterio statements thdt 

^peor on poges 2-11: Circle the ^ 
nurrtboir which reflects the orriount 
* of importqnce you ottoch to eoch 
criterion listed. Please circAe only 
one nurhber per iton^ qnd refcoln 
frdrh' dddihg frdctidnof or decirnol 
pd^hts dh the scdie. 

3. Space hos been provided at the end of 
the survey: for you*to list and rote 
bny odditibnql criteria that you feel 
were bmlHed. 



Pleost rtturii this tiirvfy to: 

th« Univ«riity pf Konmps 

D*pjEinm«_nl_of Sp*c>.ot Educotipn 
ii5H:C MiMiLf Building 
39th bnd Rblnbdw Blvd. 
Konftos Ci^y. Konidt 66103 



/1 36 
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Pleose Answer tlie fotiowing Suesfions: 



t. PI«oi« 4ndicot« th« tyf>«(4) of Hond>copp»d ttudehti for wham you t«l«ct ihstrucliohol moteriaU (•.g. 
~ mirilolly ritbrd*d, l«arhihg diioblid. it^:). 



2. P]»ot« indicot* th* grod* t«v«l^of students for whom you s«l«ct instructional materials. 



^Elementary Level -- - Secondory Level Bath 

3. Plebse iridicbte^ ybu^ pbsMibn In the school district (e^g^ self-cohtoihed cloisraom tebcNvf: resource room 
tebcher, princi^l, director of speciol educotiori. coordinator, etc^}. 



4. - Hpye_x^M'^*ceived formoi coursework or training in the selection of insiruciianal maieriaU lor handicapped 

students? 

■ ■ * ■ / . 

^ : Yes Na 

5. bo yau fe#t thot such trbinjng ti b1 vblue tb those who select ihstruciibnol hnbtehals^ 

vis No 



6. Please check the source(s} that you use to obtain information about instructiaVtal materials. 

" - : — ^ Prnlattionol journals ^ Materials disploys qt cariferences 

. / Publishers' cotologs | . ! -_- In-service meetings 

— Adtftce of colleagues 



Other * plebse sp#clfy 



7. Plebse Jhdicbte how frequervtly you use d checklist or materiols selection* form if^ selecting instructibnol 
materials for hbhdicapp#d studeHts. . ^ ^ : ^ 



.AlWoys __lOccasioriolly , NeyWr 



8. Please indicote in whot settingfs) of instructionol rftaiertols used which you select? 



Own ^Ibftsrobm : ~ School librory or materials center 

.Others' clossroams ^ District librbry or moterials center 



Other • please specify . 



fog* I 
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, QUESTIONNAIRE 

fwtt tfcj •mcjmt tf ifHp»rt«iici yii ttti^ ti .iici «f H»# fill^w^ng in^irM Whin i»Iic!injj in»1ruc»ionoI mol«riqL» lo 
bp_n_d»cppp_#d »lMd*nu^ Pl»j)»e record your _r»tpphsi By circling lh« ofipropnolm numbtr on o icol* of 1 to io 
PI«Oi» circU only p«r htm ond f*(roin from odding frocliondt or dtfcimbl poini* on lK» tcol«. 

• . • * ■ 

is rwtSi IndtcbUt fhbf you blloch hup^rtan^ lo | |. 
ihol poriitulor crli^rion. | , ' ' 5 

A rvtUfl 10 indkof*» fhof you otfoch o ■* - ' 

f%ti%ntk to thot port iculbr cfMbfion. J ' * ' H:"'^ : .J^ 

1. Jhm fifli.or product nom« of lK« mof»rioL 

: ' ^ 4 5 6 7 8 9 10 ■ 

_ __ _________ ' • ' . * r f ' 

7: Th# r»pulOlion of lh« publiih»r. ; 

- I 2 3 5 6 7 6 9 io 

- - _ _ . ■ • ; , . ,,._s 

3. Th* A«!»^_«nc» of _oj?rtyJ»yiL poL^^ ^ 
in»p*cf<on of f h* mof*riol'prior to purcho»*. *_ 

V , ... 1^ 2 3. 4 5 6 7 0 9 1 0 

4f ' , ' ; J • 

4. th» copyright or pubKcoiion dot* of th» mol«rtol. '« . 

^. 1 7^ 3 * 4 5 6 7 8 9 10 

5! Thi r)jamm orid/dr th», prdfiiilondl r»put6tion of : ' ' « t 

th# author of th* liioimrijoV. _ _ ^ 

. ..r-.- - - :: :: i 7 3 4 5 6 7 $ k 9 }V 

6. F_r«tdom_lrom biot^fv.p. tmniit, roctol. r#ligiou») ; * , 

In th» mot»rioi. _ _____ 

. ♦ - ; 1, * 1 2 / ^ ^ 5 6 7 8 9 ' 1 0 

7. Applicotton of th« moi«rjo1 with bilinguot 
children. 

, I 7 ^3 4 5 6 7 8 9 1 0 

• 8: Ed^ji' of ildrdgi drid trdntpdrtpblltty of 1h» ^ ~i " ^ 

rT>ot#riol: , _ ^_ _ ._. 

:..:...:..:::::::;;:>::.::::::::;:.:;. t » 3 4 5 6 7 8 9 1 0^ 

9. ip_»Jt_ _ c! rT>onogi'>8 component portt of th# ' 
rT>ot«rioi. 

1 7 3 4 5 6 7 8 9^ 10 

id toi* Wjth whic(i th* motvriol n<oy b« »Kor»d with . * 

oth»r t*bch«rft. ^~ 

1 2 3^-4 5 6 7 8 9 10 

__ ^ . _ _ _ - • 

1 1 : -Tbj* hurr>b*r of itudvriti who cdn u%m th« rnblirlbl ^ '\ "« 

lo! on# tim*: _ _ _ _ 

*p : 12 3 4 5 6 ^7 8 910 

^•|»» 3 ^. .,- _ ' .._ 

I # 
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A f«t«{| tf 1Jndicoi«« fhof fOu ofioch m§ bn|»on«iict to 

fhbi poHkuldr, crifirioh. 

A r«tU| •! io indtcoi«»'t^b4 you piioch o |f««r ^mI fff ha- 
^•rlifict io fKdl pdrficular crMirioh. 

i 2 ■ T h*_ om o \jn\ of dpLljr/»^»tW'y -P/. • P P r P'JP n I im* f K • 

13. XH« omouni of froining fim« n«c«siory for fh« 
* l»bch«r lb •Ifiriivil^ ui* fK« mbiiribl. 

14. th« number of itrnmi ihi rnbl«rtdl wbuld bi uft«d 
by d »iud»ni. , ' 

15. T«dch«r jirh* tdvvd fHrduQH u»« of fh« mdt«ri6ll 

16 The mol«^iplcpn»|»u of lo»V» I hot opp«or lo b« of 
on opprpprtol* l«nglh. 

17. tK« durofibn of firn« riqutriH Wh«f> O^ iludihf 
uft«« ih* mdtchdt- 

IB Th« digr*^ id Which mdtiriot cdh b^ oddpfid ^ ' 
Id iniit Ih* tcKwduU of lh# ichool ddy/jff or ' 
W'thbul dM«c1tng mbl#riPi i ui«fuln#is. 

19. Cjtpr_pnd voty Io ioliow»^in»lrwclion» lor fh» 
l*ocK«r. 

' : . - S : ■ 

20:' Cl#df. cdri^ii* arid vOftlly uhd*ritood Ihitrucdohl 
Idr lh« iiud#hr 

3l. S.p*cifiCOlton oi ihji forQi^J populolton for whom 
Iht mot«riol woi d»ttgp«d. 

- . . 

- 5i_p»fii»tP*'0" o' jyp*.®' clonroom lor which 
lh« mot«r»oi wyot d«t»gn«d. 





I 

r 



1 3 3 4 5 6 7 8 9 10 



1 2 3 4 5 6 7 e 910 



I 7 4 5 6 7 0 9 1 0 



1.2 3 4567 8 9 lb 



1 2 3 4 5 6 7 8 9 1 0 



1 7 3 4 5 6 7 8 *9. 1 ^> 



12 3 A 5 6 7 



8 9 10 



1 2 3 4 5 6 7 8 9 10 



1 2 3 45 6 7 8910 



12345678910 



1 2 3 4 5 6 7 



8 9 1 0 
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^L^^'^S-?*-' btloch IP* ' <yi twi n to - *. 

thol porficulor cri1«rion. _ x 1 

I rilMg »f 19 indicoi«i ihbt you dilbch b friit if ii- 

fcrtsnct 1o tholporticulor criterion. $ ' ' ' * 



Ihm typ« -off^eogrophic region poiircy^d In lK« 
conl«nt of tK« mbi«ribl. 



34. MdlvrJal d#v*lopcH for us* With o porticutor 
disobility Qroup. ' ;^ 



^ A. l*och«r*tuuld« included wilh or occomporying 
lh» mo1*riol. 



36. H norinclud«d. o j«ocK«r*i guid^ U ovotlobl* for 
sipbrbib purchot*. 



1 7 3 4 5 6 7 B 91. 0 



1 2 3 4 5 6 7 8 9 10 



1 ^2 3 4 



5 6 7 8 9 1 0 



1 "2 3. 4 5 6 7 8 9 1 0 

37. A compr«h»hsiv# 1#bch«r*ft guid*. ■ * 



1 2 3 4 5 6 7 8 9 1 0 



36 Tb« _fp_rmol_of__;_bt mol.vriol (•.g, wbrkbook. 
cossvit* top*, gom*. 



12 3 4 5 6 7 8 910 

•rVa\ 

wilh ftludfthls ^•ntol ond ph/sicbl obititivi: 



39; Th« compolibility off th* fformot of tK« Kkiivnal 



30- T.H*.>of«ty Imaiurmt off th« motvriot ^(v.g. non- 
loxic). 



1 2 3 4 5 6 7 8 9 1 0 



1 2 3 4 5 6 7 8 9 10 



31. th» agf»«m«nf b«iw»%n^h* fformol of th« f 
mbivrib) bhd sibl*d ob|(»clfv«s. 

/___•___ 

^. 1 234 567 8 9 10 

33. Th». oil_rocii>»»n«st ond ^ppmo\ uf lh# maimriol fb 

s '1 2 3 4 5 6 7 a 9 10 

33. *TH» d»gr»» to which ih» moi*riol oppvori 

~chbtl»hgihg ib iiudihu. 



> P«o*4 



12345678910 
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A nrtinf ff 1 jndicpt«s ihot you ottoch Uiif«rt«nc« fo .^^ « 

thof porficiilor irit#riort. ' */* J 

. ' i 

«• fo Ihol porlkulor criterion. 



z 



> 



^* Tb* . of foMow up; ocfiviltM for tkill 

rsinforcvnvni. 



''^ 35. Th* pric* of fh« mol«rjol. 



36. Th« r«ldtidnship b«tw««n •fl«clivn«is ond 'lh* 
cost of th« motvriol. 



37. Th«j9_nrluol_iTio_inf«nonc* ond/or r«plo^em*nf coil 
of fh» mof*riaj. ' ,■ 



36. th« pricft of th« molvriol's consumobl* if*m>. 



t 234 5 6 7 B * Id 



1 2 3 4 5 6 7 8 9 10. 



12 3 4 5 6 7 e 9 10 



1 2 3 4 5^ 6: 7 B 9 10 



39: Th* Omouhf of t«»och»r ihVolyemeht r»quir*d for 
th* motvridt to b# us»d;.*ff*cfiv#!y; 



40. Tb*Jr«qii*ncy of ttud»nl r^spons**^ r*quir*d by 
jhm mof*rioi. 



41. i7>i* frequency of ttudenl/teocHer interoclion 
required by fhe moteriot. % 



42. Ih_«_PQten»igL_foi^ u»e_ p_r_ gdjip lability of the 
moteriol with other thon the stoled populolion. 



43. 'The odoplobilily of the moteriol to o voriety.of 
leochcrs ond teoching siluotions. 



44. The bppJicblibn of the rnbterlbt in other oreos of 
the curricillum. 



.— 1 2 3 4 6 6 7 , a 9 10 



1 2 3 4 5 .6 7, 8 9 1 0 



1 2 3 4 5 6 7 6 9 1 0 



1 2345678910 



1 2 3 4 5 6 7 8 9id» 



1 2345678 9 10 



1 2 3 4 5 6 7 8 910 
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A rstlni tff .1_indicot«s that ydu ottoch n* lmp#i^ifici to - <. r 

fhoCporticulor critirioh. ^ S i. f: 

^ I I 

A r«tm| •! 10 indicot»s thot |rou otioch o |ft«t ^Ml to- 1 "Z 

f#rtiR^ to fho( poMiculor criterion. ^ J ^ • 



45. TK# provifkion for g*h*roli2otidn of Rnowlvdj;)*. 



^6. TK« jj^rjL»»nc»_ftf_»u09****oft» for tuppltfrnvntpry or 
olt»rnofiv»; l»orninB octivififts.^ 



1 2 ,3 4 5 6 7 8 9 1 0 



^ ; X. 1 2 3 ^ 5 6 7 B 9 10 

J7. The proviiioh by fh* pubji^^ 

Which support th» •fl*ct>v«nfti> of th« mat*rjol. 



43. Evident* ^hdt th« mbt»riol hoi b»*n revised ond ^ 
upddted reguldrly. 

^ .............. 

49. The_ use _oJ_teocKing methods thot ore suj^orted 
by empiricol evidence. 



13 3 4 5 6 7 e 910 



1 • .2 3 4 .5 6 7 8 9 1 0 



1 2 3 4 5 6 7 8 9 1 0 



SO. tvider<ce thjit the hioteriol wqs _d*veioped 
•hrbugh fhe yse o[ soynd reseorch ond 
develbpTient procedurri. 



Tent pre 
12 3 4 5 6 7 8^ Id 

Si : The presence of d vdriety of respdhse modes by 
t. which the tt^eht mdyr dimdnstrdte ledrnihg. 

. __ •__ _ ■• _ _ 

1 2 3 4 5 6 7 8 9^10 



53. A voriAty of different ond interesting woys of 
presenting instruction. 



^- - r-.- 12 3 4 5 6 7 8 9 1 0 , 

^ '^33. the utiJizdtidn df d spectflc.instructionbl op ■ ■ . . ' 

^ or method. ' 



S4; The^ pKysicol quotify, ond durobility> df the 
moteriol. ' , 



1 3 3 4 5 6 7 8 9 1 0' 



1 2 3 4 5 6 7 8 910 

55. The clority ond size of the moteriol's prinlT 

: . ■ " -J » 

1 3 4 5 6 7 B 9 10 

ro9» 6 i . - 
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A rvtuifl. if lindicotvs thol you ottoch no ImportMic* to . ;| 
fhot porflculor cf\tmr\on: 2 J 

I . 1 



porfm* 1o that pofliculor criterion. ' # >^ 

- - - : -H - - - ■• " ■ 

56: Th» ^ockaging of f hk mof •riol. 

1 -2 3 4 5 6 7 ^ B 9 10 

• . ,57. th» clorlty, o11rocHvn»»»^nd <ipproprio1» 
; ./ ■Illutfrofiont ond^f phoi^rbpht tb*tn^ 

th» mbfvribl. . » , - 

i 2 3^4 5 6 7 e 9 lo 

58. A formbl ihbl l» unclu1l»r»d/gr^ 

and Umm of typogrophicbl mrrbn.-^ . . 

:r:;^.:,:.\..... i 2 3 4 5 6 7 8 9 id 

59: The dgrrertianf b#tw**n fh» mcj1»riol ond cur- 

riculbr obj*Cfiv«t. • 

.1 2 3 4 5 6 7 8 9 10 

60. Thr_rnoterioi opp»art to lulfiirilt tlot»d or implied. 

' ob|»cfiv»t. *• 

............:::. 12345678 9 ib 

6f. Obi*c1iv»t tfoled in behbvlbrbl ibrmt. 

::.:..:....--... ^ 1 2 3456789 10 

i62. Th« p^^bhcb of ihtlruclibnbl bbj»ciiv»t: 

1 2 3 4 5 6 7 8 /910 




63. Th*_obL*cfiv»t of lh* mo1»riol m»»1 t1ud»n1t' 
off»cfiv» n»»dt. 



h« rral»>Io1 i 



1 2 3 4 5 6 7 8 9 1 0 



1 2 3 4 5 c 6, 7 8 9 10 



1 2 3 4 5 6 7 8 9 10 

66. th» moferiot'i conlini it presenlbd tbqubnilblly. a 

/.... *.;.......:.:....:::.-::::::::::::::-:: ^ ^ 3 4 5 6 7 8 \9 '0 

i -* ■ M ■ - - ~ - 



64. 1^>» bb[ectivb» of fh« rrfc»>^l o>»;'iA keeping ^ 
f he »1udent»* ih»truc1ibfibl*he#di. : 



6% A tcbpe ond teqOehn- chorl occomponiei the ^ 
* rholeribi: 
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k fvlini rf 1 indicaf»» fhot you Offoch Hi fopirtwici 16 

that porficulor crHvrlbh. % 

^ A rvling of 10 tndicotvs fhot yrou otfocK a frMt tf hs- \ 
mrtifici Ib'fhof porficulor crifvrioh. J 

67. Th» mat»riQl_ii_design»d. »o fhot r»p#fifi6h ohd 
r»vi»w of confvnf occurs fr*quftnfly. 



.^9\^j\^y}y^^>]SF^!^J^. f^of Ivor nlng occurs in 
srDoll unlfft of ochi»v»rT>»nf.. 



69: Thv voft* wifh which f«dch«rs may us* fh» 

mat»r)6l; 



A- 
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1 2 3 4 5' 6 7 



8. ^10 



1 2 3 4 5 6 ' 7 8 9 It) 



70. Th» ft_kIllft_Qec«ssory_f o ut* f h« motvriol vffecf iv»ly 
or* compotibl« wifh fh» f»och»r'i •xp«rtii»: 



'71. th* provision ^ fh* publisher of in-s*rvic* 

froining. \ 



•72. TId^ch*r^ frbining fridt*rrols occornpony fh* 
imtrucf ionol material. t- 



73. fh* _p/*_»*nc*__of_ diOgootfijL ond pr*scripfiv* 
d*yic_*t for plocing sfudtnf of opproj>riot* *r)fry' 

r*bd|n*ti behaviors n*c*s so ry for ftfud*nfs who 

will t|nB fhe mdf*ribl. 

76, Repiocenietf! pi»c^^ brokj»n ItvrruL. 
9^j^l*'PfL°L corT)por)*r)ts. *tc.j moy b* purchoft*d 
t*parot*ly. 

77. The dvoilobilif y of •quiprD*nf n*cesssry fo ufc th* 
ftiofiridl (vlg. prbj*cibrs. cassette players). 



1 2 Z 4 5 6 7 a 910 



34567691 0 



1 2 3 4 567 B9 i0 



V 



12 3 4 5 6 7 8 9; 10 



1 2 3 4 5 67 6 9 10 



1 2 3 4 5 6 7"8 9^10 



1 2 3 4 5 6 7 6 



9 1 0 

J 



1 2 3 4 5 6 7 6 9 lb 



5 6 7 8 9 10 



Pep* I 




EKLC 



JEST COPY AVAiUOLE 



s 



^ ^ i - _ 



A rvtliifl ml 1 lndlcot»t thqf you ottoch m lmyrlic< to ~ 

fhot ponicwlor criterion. 1 : . , * 1 

f*f1«iK« to thot porticutor criterion. ' £ ^ 



78 . S u p_p rrvo nt q i J t frn t {:^. pjpc •rn»nt t»st s ^ y Is u o t 
' oidk, ditto mott»rt) occomponing th» mot»r(oj. 



1 7 3 4^5 6 7 S 910 



79. SuppI«m»nt6J- rhdt»ridli -(i^B. p1dc»m»nt t»its« 
vilud( oidl, ditto rndst»ri) dvdildBl* for iipdrdti 

purehaiA. _ . _ _ ^ 

.. I 2 3 4 5 6 7 6 9 1 0 

80. Th» pr»ft«nc» of o u»»ful bibliogrophy. t ■ ^ 

/ X , .: ' 1 2 3 4 S 6 7 8 9 Id 

t ■ ' ■ f - - -'^ ■ ' 

81. Mojjj'ipj diMjgnvd to opp»ol to th»?^^int»r«st l»v»t 

< o1 th» >tud»nt. I . 

- A.... 1234567 8 9 ko ^ 

-J 82. Th» iuitdbitlty of tf>« ihttruciidnol l»v»l td tKi / 

itud»nt(»}. " 

\ .... 1 2 3 4 5 6 7 8 - 9 1 0 

83. TH» r«ddihg l»v»l of th# mdt»rtdt ti lhdtcot»d &y ' j 

pM^I»ih#r. ' ■ ■ ^ M 

- V 1 2 3 4 "5 6 7 8 9 1 0 

84. Th« dccurbcy of th» cdnt»nt of th» mot»riot. 

" / ■ » 

' ' 2 3^56789 10 

.. .. ^ . ^ . f . ^ 

) ^ 85. Th« _ _C©ni*nt_ of__th»__mot»rio! \% cI»oHy and/ " ^ - , ' , 

yndvrttondobly pr»t»nt»d. ' i ' 



66. Ad|i9^q|r of :^Hm >cop«. ond^»quenc» of th» 
content. 



1 2 3 4 5 6 7 8 9 1 0 



Z 1 7 3 4 ^5 8 7 " ^ 

.* 57. Th» cdmpdtibWtty df th« cdht»ht of thi mdtirlbl - 

with dthir dh-gdihg ihttructidh. J ^ ^ ^ 

^ ^ ^- i:/^::::^.. * 2 3 4 5 6 7 4 9 lb 



88. A_focy» ofLjkJUL o nd k no wl»dg» tbot orir ui»ful 
^ ond Qpplicobty to th« student. 



I 3 3 4 5 i 7 B 9 

r 
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^thof poriicuiar Cfitsrion. | 

1 ftfeg >f 10 IhdicoU* thaf^ou affach o frtci 4»ai tf fan- f . . ^ ' ^ 

ptiBnf to that ponlcv\ar critvrion. 1 • ^/ 



09. ihm provision of suHici«nf opportunlfias lor 
prbctic*. 



1 >2 3 4 $ 6 7 8- 910 



90. Accompohyihyv forms fSf ! f •ceding' sfudtfht . V 

progrsit. _ - ■ -i. ; ' , : ^ : 

- ^../l)^..............:......;..;;..::. 1 2 3 4 5 6 7 8.9 1 0 

9br Ac_cp_rT)p-anyf|n9 -lormt for •voluatihg fttudiht 
/ progrm%%: • 

' * ..'h*. 1 2 3 4 5 6 7 'a 9 10 

92. Prpvi»ip_n for th» ttudant to trock his/har own * 
progrstt. ' k ^ 



93: EcA* with .Which th» -f»ach«r cori ut» fbrrnt fbr 
recording and/or ivbluating itudint progriii. 



94. f fpjyrjrtt •yqjuatipn r<tt_ul_tt_qtJow f_p_r_dLrji_ct plan- 
ing of the ttudantt' iQttructionaj program. 



95. 'l^9_c^*^^^*° for__occ«ptobl(i ttudvnt p*r?ormanc« 
ttbted m behavioral tarmt. 

J.::..:.... 

_ " 

96: Evoluatibh itirrit cbhiistiht with prbgrbm bbjbcf- 

............ 

' ■* 9^ _ Th*___P'^oviiion for Immediota feedbocly^o 

ttudentt. 



''1234 5 6 7 8910 



^ i 3 4 5 6 7'e 9 10 



1 2 3 4 5 6 7 8 9 10 



1 r2 3 4 5 6 7 8 9 10 



1 234 5 6 7 8 910 



. r. 1 2 3 4 5 6 7 6 9 10 



9d. The prbvU»bn of pre bnd pott tett octivitlet. ^ 



1 2 3 4 5 6 -7 6 9 10 



99: The provision for cohtihou» oitettrheht of »tud- : • 

ent progrett^ i 



1 2 '3 4 5 6 7 8 910 
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A >^|nf 1 ihdicot»s^h^b|you ottoch p* biiportmc* to 

<thbt pbriiculor crM«r^ii^/|^ 



ft ffvtlhg 1Q ihdicot«s i >at you atloch o |r*«t sf Im* 
^rtahci to thot pfiHicular crltS^rlon. ^ 



I' ^ > • ■ ■'• ' -.-J 



Ibd. incluBion of gumlinvs for tK« •voluotion oif^ - *^ \ 

student progrstt. ' - ^ ' 1 



s 



) Ol".. Actlyltjss^ for jA9mon%Ua\ ion_ ol tosk moit • ry o r« 
compotibi* witbfttudent^ obillty. ^ 



102. Ciority with which r«irrforc«m«nt proc»dur«s or* 
tp«clfi»d. 



1031 Provisions for f«tl«orhlhg ohd r«>oss«sim«hf in 
th# ivAht of post t#st foiiur«: 



104. Th»Jd»gjy»»_Jcr whLch_f|>A^ appaors to 

b« rtiotivoljionoj'to stud«nts. 



1 2 3 4 5 \t 7 8 9 1 0 

•. ■ * . ' 

1. i 3 ^ V 5 6 7 a 9 10 




Pl»as» odd ony odditionol critsrio end rot« th^f im^rtonca of •och. 



105. 



106. 



107. 



106 



109. 



I' 



12 4 4 ^ 6 7 8-910 



1 2 3 4 5 6 '7 8.9 10 



1 ■ 2 3 *^4 5 6 ^7 8 9 16 



1 2 3 4 5 6 7 8 9 1 0 



. T s 2 . 3 4 5 6 7 8 9 1 0 



0" 
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If Yioa would like fo rhaRe any qtddifjbrtdl comments 

instrjdftfbnalymdieriof^ for Jian^icapped students, please uSe ffiis space for 
that porpbiei^.;^ ^ 



7; 



9^ 



^09* I? . 
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Your pQrf.dDd.ior. In this stjfc is gr^ ipprecFoted, If yo.u would 
nkrto receft.d copy ^of the sun.ey .fl^ pnnt year ,,ame ond.ad, 
dress on the r.hesf below. . , ■ 



4 



,,-3 ^V- 1 



■ r 
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THE UNIVERSITY OF KANSAS 

_ Jbepartraent of Special Education 

_ College of He^^^^ Sciences and Hospital 

39th and Rainbow Blvd., Kansas City, Kansas 66 103 

(913)588-5944 ' 

(913) 588-5943 



. . ^ . • ; 7':., ■ ' ; : rr^ \ 

I amxurrently_conductihg_a r^se^ study funded by a grant from the 
Department of Ediication, Office of Special Education^ Jhe study is 
desicgied to resul t .in_ the developrnerit of a model process for selecting: " 
instructipwrtrmateria for handi^pped students: As ^a_part of this 

'process i^t is necessary to identi-fy the criteria currently used in the \ 
selgctiow of, iris'tructiocial materials. The results of this study wil> 

.be used'in the.vtleve^bperit of a weighted selection checklis't/ 

Tf^ enclosed survey ^ is -bsgitig sarit to persons throughout the United; States 
who,,-are responsible for seT^^^ materials for elementary 

andi secondary special: education students. You were identified by your 
. local Director of Special Education as an individual who ha^ this re- 
. spdhsibility . j , . " ' .^^^ 

/ The directions for* c^ the enclosed survey are listed'on its 

coyer. I wduld a|fiP6eiate receiving yourj^ompleted survey by Apri-l 22 , > ' 
1981^ A stamped seTllraddressed envelope has been enclosed , for your con- 
yenience. For every^J^SS sorveys, completed and returned by the ahove 
, date, I'Will make a $5/09 -contribution to the ^Foundation for Exceptionar 
Children,^ a non-^prof4t organization established by the Cot^Hcil for'Ex- 
ceptidnal Children. '. , 

- f ■ : - - - . ' ^ __ : ' / ■ : 

Your participation in the. study is voluntary and \5|11 responses will be 
-. kept ebnfidenttal ;^ :The code number that appears on your survey will 
drily be used-' for record keeping purposes. ^ 

Thank\you for^yd^r -assistance i^ . ' 

Sincerely, ' . V 

Hary VerituraV " ' - 

Project Coordinator ^ ■ ■ \ 

Enclosures' ■ ' • ' ^ . * 

^ - 151 
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— -- -. '- -- - - _ Main Csmpus, I^s^rence 

College of Health Sciendes and Hospital* Kansas City and; Wichita 
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Approximately 3 weeks^ago you rece ived a: Survey t i t led 
Selecting 1 ns t ract i ona 1 Ma ten" a Is for Rand i capped 
S todent s . The purpose of the survey is to determine the 
criteria that you feel are impor tant v^hea you sel ect 
instructional mater;ials. 
' ■ ■ , " ■ ^ 

/ij thouqh' the "return date on the cover l et ter* has passed , 
the informati9n th'at yoo can provide ts most importjrfnt. 



- If you have a 1 ready ' returned your survey , please agc.ept 
my thanks".. \f you have not returned your survey , would 
you talo§ a few min'utes and do so today? 

. ^ T ha n k 'O u i: p r : y assistance. 

i . '-y;;^^^ *■■ Sincerely, 

•"' '-^-V'-r ■ 'Mary Ventura ^ 




APPENDIX v3 ' 



Survey Items in Order of importance - Sub^ects^ 
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3;5 • 
3;5 



8 

-9 



Statement ^ ■ ^ 


Mean 
Rating; 




■ D. 


7t 

■ Weight 


Clear, concise, & easily; 
understood instructions* 
for the student. . 

■ ■ . ■''^ ■ \ 


9.22 




.31 




The suitability of lh€ . ' 
instructional level to 
' the stsflent. 


'9.20 


i 


.07 


11 . 


The coiiDatibili.ty of tfie 
format of the material 
with student's mental and" 
physical abilities^ 


9.16 


1 


.27 

■- 


; 11 . 


The degree to which the 
material appears to be 
-motivational, to students.' ' 


' 9.16 


1. 


,27 


' 11 


The eonteht o^'f the- material 
is clearly and uhderstahdably 
p^esented, • . 


9.14 


1. 


15 


11 


r A focus b.h' ski l is that are 
Useful and applicable to 
the student. 


9.02 


1. 


26 




Material d^H^hed to_ appeal 
tP the interest level of 


9.66 


1. 


22 


11 


the accuracy fef. the content 
-Of the material . 


8.99 




33 


11' 


The reading level of the • 

material is indicated by 

tfie pubi isheV. . • ■ . ' 


8.87 


1. 


54 


■ ■. 11. ■ 



t'-.. • lOV The obagrctfyis of ■ 8.80 1.47 11. 

8.72 l.SCrn-' 11 

j|^|ifi.dp?igned ^0 8.70 . 1.45 11 




'ass.'.-- -.Jff--.. ..V .i-rp' -f.; 



14 " The i4latidhship between 8.69 1.69 11 

effectiveness and the -cost * 
of the material. v 

15 The attractiveness arid appeal 8.64 ^ 1.41 ^ 11 
of the material^to the students-. \ « • 

16 The mat'erial , appears to fulfill 8.6E 1.54 ' 11 
^ its stJt^d or implied bbjectives. ^ / " ^ 

__ _ . ^ ^' 
17.5 The agEeemerit between the 8.61" . 1.55 11 

material and curricular ' / . I 

objectives, • * 

17.5 ■ The Material is designed so 8.61 " ^1.52 11 

that repetition and review. 
. ' of content^ccursVfrequeritly. ^ 

la The forniat of the material : 8^57 1.6^ 11 ' 
(*:g. workbook* cassitte.^ : *, 

tape, game* etc. ) ^ 

. . - - @- 

20 . The _ pro vis i oil for suffi- _ , 8,56 1.46 11 

'cient opportunities for * ... , ^ 

' practice.: . , . . - ' 



21.5 The degree to whlch the , ^ 8.55 ^ . 1.46 11 

/ material j[gpears challenge . ' 

ing to students:^ ' • / ' v ' ; . . : ^ 

21.5 • The material *s cqnten^^ :^ 8.55V 1.64 < . 11 

presented sequentially. \ . £^ ^; 

23 The agreement between the ' 8.53 1.72 11 

- fonriat of tKe ^materffl . */ ; ' 

and statedt objectives. 

. " ■ '.' * • • ' • ■ 

^24.5 A teacher's guide included 8.50 1.85 11 

with or_ accompanying the -* - 

material , > ' " 

24.5 The ease with which teachers 8.50 1.48 * 11 

may use the material. . ' . 

26 the presence of followup 8.46 1.64 > 10 
activi ties . for skill rein- /' 
ifprceigerit. ' . b . . ^ 

27 '^.^,.vf?^he consists of \ 8.43 - 1.56 ' 10 * 
Avri^ji^lcs^th^^^ appear to be 

f'ffir .-. ^ ::- . . : ■ ^ ■ - • 
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28 ^ The presence of diagn - * 8.39 1.68 10* 
and prescriptive devices 
for placing students at 

appropriate entry levels. ' v 

29 The prxivision for continuous 8.38 1.61 10 ^ 
' / assessment bft'stadent progress. 

30' ; ' Provision for re-learning ' 8.37 1.73 ' 10 

-i^. and re.gjs3g53jy^P^ in the • ^ 

; 'event of pt)st- test failure. ' :/ ^ : 

Activities for demonstration .8.36 4-63 10 

, . , b^f task mastery, are compaitibl^ ^ , " 
% wi(;tft, studentsV afbiUty;- ^' ^ 

V«S ' S^i^a^^^^^^ items Sprisist^p^ * 3;^ ^-/t - 10 

K^^^ 'y^ program objective^.*' .5 ' --pr^ -=>^ ^ 

' * life'^^'^'^'^ * — - , - ^'-f / 

^^5^ ^ '"^'^^ P*^^^^^^ 8#31 ^ 1.68^ 10 

. ^^-^^ PPSt-test;;,^ciTfiti^Si5^: ' 

^^c^^ 3^ Vd^tty^^^^^ef^tA^r: . . ^„ • ^ 8.29 • \ 1.66 10 

and In teres ^f^' ways b v ' / - / 

pres#niln9^'ins^ ' ^ ^ ' ' - ) 



35 .^^^ 8.28 • 1,74 10" 

; the material * s pririt. ^'t^ - 
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.^^^^ 36vS Adequacy of the scope arvd ,8.27 1.71 10 

'"^ . sequence of the cdhterit. ^ ^ - 

36.5 - The number of ^ times the 8.27 1.69 10 

; , V material would be used . 

by a student.' . > , * 

38 Clear and_ easy to fdllo^^^^ . • 8.2§ 1.7J .10 

instructions for thV' . 

ti^acher. ^ ^ . . , .• " ; 

39; 5 The price of the material. 8.24 1.95 10 

39.5 The compatibility of the ^ 8.24 1.58 10 

material with on-going * ' 

instruction. . • t^^:--^ . , • 

^ -41 The physical quality and 8.23" 1.66' 10 
durability of the materiat.-^ 

42 The annual maintenance 8.22 1.79 10; 

ahd/or replacement cost ^ / - \ 

of the material;' ' . ♦ 



AiCQmpTehensive teichers' 
gtiide. 



The jDrice of . the materiaVs 
cbhsumable items. - \ 



r 



, .The bbjeeti ves of the material 
meet the student's affective 
heeds . s ' 

V - * 

\ The prese^^R^M^ variety of 
respbrisie ^dei by whi ch the v 
student- may- demonstrate ; 
. Tear hi r®; ' 

The spec«icatipruof the - / 

prerequi?T4£' skil.ls*^or ' , 
^ reeWihess .beh^avibrs _ 

. nec«s ary Tbr. s tudf nls , _ ^ 

who wiTl us| the materi ^T. W- . 

If not ihcludedi_a teacher's ' 
guide is available for 
separate purcliase. ^ 

Progreiss^evaliiatibh results • 
allow for direct plahhih'g 
0^ the student's ins true- \ 
t\onal program. 

Teacher ^time saved thr^rtifgh^^ 
the\uSe of the m^teria^l.^ 

The amount of t&acher \ ' 
involvement reg^red for " ^ 
tbe material to be used ^ " 
s effectively'. . ^ 

^ V- ' . . 

The amount of tecrcri§,g 
involvement requi r^jf^/For 
the material to be uSed ^ 
^effectively. 



• • 8.20 
8.15 

8.12 



2.06 
J.. 88 
1.80 



1.. 76. , 



1.-80 




10 



10 / 




8. 10 



2.09 



^1.86 



*7 



The availability of ^ 
equipment necessary tjo', ' ^ s 
use the material (e.g./ f 
projectors, /cassette . ^ 
players). :^ 

the ambuht of daf ly/we^kl^ . ^t 
preparation time^ the ^eachef 
must spehd tb effecti vely'^se 
the material . ' 




55 The skiniSs. necessary to use , 
the material effecti.vely are 
compatib^ with the teacher's 
expertise. 

- - — ' i 

56 The degree to which the material 
can. be. adapted to meet the • 
schedtf^^af the s^oo^_day/year 
wi'thbu'T if+'f^cting the mateViaVs; 

^ usefulness.- 



7.86 



1.86 



57.5 The* jduratiofr^of time required 

when S» student uses the material .i 

57.^ ^ The frequency bf student y^spbnje 
required By- the material . 

59 ^ IReplacement/pieces. (eig*; 1o§t 

or broke n. i'tgfts, additional/ - . 
' cdni^bnents etc.) ipay be pu?-^ ' ^ 

chased se|>arately ; " - . 



^50 



The diJibiint.bf trai hlng- ttme' - 
hecess*ary for the teache?^ ' 
to effectivgl^ use the 
material..: ^ 

Supplemental .jyt^3is ( Si g. 
placemeht tes*t§ir V;j^i 



7.83 

■ \ 


\ 1-97 


9 




. -.i .;; •. 


- 




1.82 


9 


7.81 


V l.fe 


y 


7,80 


_ 2.10 ; 




7.79 ■ . 


1.99 


9. 



X 3 ^ 



ai ds -y di ttOi^as ters j^^^ ' ] i 



• 6 2 ' 

— n 

63; 
65 



accompanyiria *.t)ie"mate^jp3a^ } 

The presence bf instructional 
objectives^ . ^ ' 

The pravision for generajl.izatioh 
bf l<5jdwledge. * 

T^^e jH^g nee o f a p re y i ew 
polji cy whi cfj al 1 ows i hspec- 
^ tioVr of the material prior 
to purchase. \ 

I n ?1 u s 1 0 n 0 f ai de 1 i^e s 
for the evaluation of 

the* student progress. 

f- ' *^ 

eiarity'with which rein- 
forcement .procedures are . 
specified'; , • 




i:84 




7.67 



2.11 
1.7'6 



9 



9 




1.90 



i.ao 




9 
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67 



68 



B9 



7D 



■ ' 71 



72 



^73. 5 



the presence of suggestidns 
. fpf^ S4jpp1ementary or alterna- 
tive J^i^rning activities. 

Th^^aptability the 
^^a *Sri a 1 to a va ri e ty o f 

' /teachers and teaching. 

: ST^uations, 

Qbjectiyes seated in behavioral 
terms. *r. ' ^ 

The criteria for acceptable 
student penformance stated 
, in behavioral terms. 

. Specification of the target ^ 
popul^ation for whom the ' , 
te ri a 1 was ^des f g ne d . 



The ease with 'which the 
teachers can use^orms for- 
recording'^aYid^ evaluating 
student progress-. 



(6 number of students who_can"' 
e the materia! at one time. 




The applicat1;Dn the jnaterial 
in other areas/ o/^ the curriculum. 

jThe cUprtti^/'attrac.tiveness, and 
' app^rdpri ajfrness^^^of rl 1 us trati ons 
ahd/or-jjfjbfli^^rd^ the con- \ 
teq;^b1^the material.- - 

Suppllrtierrtal'tTiateria^^^^ 
'(e.g, ple^cemeht -te^sC 
visual a^idSi di tto: jftiasters)^ . - 
available for s^p^ate' pur-j5* 
chase, " , . ' ^ 



Ea$e of|ma.riagving cbmpbri^'ht 
parts or the material: ^/ 

■ i 

The pi3tenti;^'l for use or v_ ^5 
adapt^bi 1 .ijtf^xrf . the m^^teri al ' 
wi.tPf other ^,th'^:1t^ 

poFfuia£iori:v|;5:^^ 



79 



E y i define t h^a t the ma ter i aV J ' 
Fi-as been revise:<t',ancj 4jpda%d 
regularly. S ^ ; 



7,65 



7.64 



V 



7.58; 

7.5 a 

i 

' 7.54 
7.50 

-• 7.47 ' 

- 

7.47 
7.45 

7.44 



2.25 

t 



2.26 
i.08 

2.23 



•9 



. 9 



9 ' 



T 2.15 



2.22 
•1.94 



r8 



"1.98 



7.4i 
7.39, 
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/ 




2:13 



2,25 



2.00 



8 
8 



80 AccbiSpapyi for 
eva^^Mt'^Hg student pry< 



7;;33 ^2.20 
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.81^ Evidence that tlie_J^terial 
was developed thr^gh the 

• use of' fsdund research ihd^ 
development procedures. 

82 Ease with whlq|)vthe materieS^ 
may be s^ar^d^^i th-'^^^ 

• teachers . - 



7.20 



^.30 



' 83 Material developed for Use 

with a particular disability^ 
group. 

•^^ 84.3 Freedom from bias (e.^.^ 
-K' sexist, V'acial i religious) 

in the material . 



84.3 The utilization of a 
specific instructional 
approach or method. . 



"84.3 Provision for the student 
to track bis or her own ' 
progress. ; J: ' ^ 

87 The use df. teaching^iriethod^ 
• * _ that are supported By em- 

^. pi rical evidence. , - 

88 A scope and sequence chart 
accompanies the material./ 

'^89 ^ The s^afety features of ^: - 
the material (e.g. non- 
toxic). ■ , - 

/% ; Specification of the "type 
^ of tlassrbbm for whi ch* tfjF 
. . . material was designed; 

r.- ■ 1_ - _ ■ - \ - ■ - :_ 

91 Teacher traihlhg materials- 
y^accbmpa 

- N If niaterial. , ^ 

*J*^j^ - • - _ - _ • - . • 

92 -^^7 Accbmpariyirig '6>.*''^^c^r 
A ^ i ^zX^fecDrdirigi^stud^rt^^^ 

' ' ' ^"^i^ *^ rp V i s i d h by t h'i^TjUbK^ 



7; 19 



2, 30 



8 



s 



. . J bM'sHer 

I fi&ld test^data whi^h^sup-' 
^rt tng effectiveness of the 
^'^^erial. ^ ^ ^ 




. -6.99: ,^v,2.28v,:^ 

■ ft.- .' ■ . : ' " 

' ■ 6.97. ' 2.17 ' 
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6 .7 



12 3 4; 

the exisyhee of a p^vlew policy wl^ich al]ows- inspeBl*j 
the iTiateriat prior to purchase. 



■5 



8-9 iS 



(X §1 




I^clusidh of gUideH^s f^r the evaluation of student pr6g%s-^^. v" 
1 2 3 -4 5 6 . 7 8 9 IB (x 9) . ' 



66^, Clarity with ^hi eh reinforeeraeht procedtrres . are specified'. 7- '"^ ^iJ'^ 

9* 10 . isU 9) . 



2 % ' 4 :.^; 5 



7^ 8 



62. The presejice^ of suggestion^for supplementSfy ^ alternative ; ; 
*lea£wrii_ agt'ivities. " ^ » 



:voni^o 




6 ■ 7. 8 9 /TO V (x 9), 



I ty^f > ttfe^ in§ te 1 to » va rje^' of ^ache rs\an(| , 





•^^^^^bql'ttive^ stated in Uef^oral teritis. 




70^ wie Criteria, for acceptably student perfdrmarice sti^ecT irr 
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73. The jiUiTiber brstUdeflts who- canf use the ^^i^l at oije "t^^1e 



■1 



3 4 



,74- The applt^atf 




_ 1 



10 v" 



(x 



^ . 

V'-'^'* The clan* fyf*l^ractiven^^sV^r^ appropriateness of 'illustration-S' 
and/or ^photographs-. to .the -ebrktent of the materi al . 



Sugpl^iit^l Jnat0ri>Ts (e.g. ,• f fffc^ntitests , ■*vi sual aids , di tto 
^.masterrj avai^agl^ for separate- p^ : 



' >^ -^4 • ' |^sf%l^manag^ng"con^^ . > % 
. >2*.<3. :'4 .5:- 6 ^ .7 n« / 9 : : X^. ^^^'^^^ 

• 7^- ^HPOten|ial fcf^r use^^ with other J 

, tharls tgvlfeiiaBd poRuiation.- I ^ • ° , ( ' - ' - -'T ./ 



;7^. /^^poten^tial fcfr use^^ad^ with other • « , 

, tharls tgvlJ^iaBd poRuiation.- I ^ • ° . ( ' - ' - -'f . 

- / Evictehce 





6- 7 8 9 



;s — 

hB5wt)e||5 revised "^r^UptJS^d "a^^Haf^y .^* 




m 



fpr-^val uati ng 's tfideiilt pro^^iM'^' . 



'4 ^^^^ ' F :*"iy.-a% . 



: J 2 T^?4 '• 5 6' 7 



jL83V .Material ^ve?Me for -ose with a partiSu3ar dis'ib-iTtl'^gTO^ M^^.. 






;"Ease( wiwi wlii^h the.-'^nfeter l'a4-iiiy 

b' 



d*'^hrQu|H^jiM^,^^ sdUhd_ 



r 



7 9^^w^^^t^.m^ 





8 9. 



Vh^^til i-z^t^oh d^^ipa^^ a 





&' 7 8 
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ach "br method. 
X 7)' 




Pro.vjsion for the student ttf track His brijer-owri pr^ _ " 




86 



87; 



88. 



10 



evidence. 



ff that are supporj^ed b^'emptricral * • 



IB 



(x 7) 



1 '2^^ 3 4 5 ^6 7 8 9 

A si^gpg and. sequence Chart accdrtlpanies the materl^V. ■ • i Mjt * 



3' 4 5 



7 8 



10 



(x 7h 



^B^y ^ Tile safety features -of the material (e.g. hbn-tbxie) 



1 2 .3 4 '5 6 




^ 9 10 



(x ?), 



gel : Specif iSation of the type of classroom for whicJi the materiaf^ 
^ was deigned. - . ::v^ 



■J 



,vv3 4 5 :;.V6^^' 7 8^9 10 



(x 7) 




- " -. ^ . - ■ - . . . ■ __ ■ 

91. Teaeher training materials accompany the instructional 'rn^erial * / % 



2 a /^4 5 5 7 8 9 ^ 



(x 7) 



92. ^^^Aeeoiiipanying forms for recording student progress. 
• ■ \^*.2 ^3- 4. 5 .*6 7 \8' 9 " 10 



.>&3._ The ;provisiGn by the puBlisher of fieldTtest d^£a i^hich support 
_ the eff^^i veness of the material . ^ ^ 

6 '-f^J- ■ 8 9 10 
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98; Ease of storage and tranf^tfability of the matenal; 

' ^ i 3 4 5 6 \7 9;, l6 (x 5) ■ 

99. -The. provision by the publisher of in-service training; 



8 



10 



1D8; 
101. 



(x 5) 

Ix 4) 

■ ■ h 
(■X 3) 

type of geographic region portrayed in the 'niate rial 



. 1^ ^ _v / _ ; 

The presence of a usreful biblioffeaphy. 
1 2 . 3 ■ 4 5 6 7 8 9 lb 
the packaging of the material. 

"^'^ " 7 .8f 9 10 




2 .. 3 



8 



10 



(X 3) , 



ISS.^lSipTicatipa of the material with bilingual children. 

4 '5 6 7 8 9 10 V ^^(x'' 1) 



104,^^ name oj the materia^? 



' - ■ "1 
V < 

i • 





8 



10 



a 
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MICRdCbPY RESOLUTiON TEST CHART 
NATIONAL BUREAU OF STANDARDS 
STANDARD REFERENCE MATERIAL lOlOa 
(ANSI and ISO TEST CHAFit No 2) 



1, . Sample ^ages of material _albn^^with de 

2. Presence of eolblrfUli relevant^' sequential^ life-lik^^ 

3; Preview' pblicy especially if author or publisher is riewrurifarniliari 
or uriRribwri. _ _ _ ^_ : 

4. Prefessiotial ism of publisher's _tatalbg. _ , • / 

5. ^ Accessibility arid cbricern for feedback of publisher. 

6. ^ Avwlabili'ty of 'a behavioral^ rtanagemerit system td accbmpariy , _ 

niaterials. _^ _ ^ ^ . * ' 

7. The material can be presented i.ri^a variety of ways based bri the 
child's learning style. _ - _ " __ ' ■ • 

;8.t The degree to whicli it "looks" like ai"regular" --tejktbdok . ; 
9. The degree to which it will meet' the future career -heeds of the 

studerit:. — v ' \ - ^ 

10. Re-usable mltirials from year to year. - ^ ;^ ' ' .* 

11. Materials directly manipulative by students. . . v 

12. Many ley'els of s^ curricUluni area covered in one kit, tape 
set* ett, . : . 

13. * Suitable for widely varying abilities' and ag^^ 

14. ' Ease with which materials may be^plugged into lEP stated objectives. 

15. .Material that comes with enough of a range that b.ne does not hav> 
':t6 buy each grade level package to gover intermittent level plafce- 

ment. _ _ . - ' . - ^ 

16i In black type so thgy can be reproduced by the teafch^ ^ 

17.. Pncivisibri by the publisher to provide option for obtaining sample 
' __: materi al s . ^ . > ' 

18. Individuality of components. « ' 

19. Thought provoking cantent. 

20. Age appropriate materials . _ 

21. Materials that are based on real life survive 

2_2 .„ Wgrd jDlaegment spacdjg. for l.D^ A] d^ '-Wi thout overcrokdi ng, = 

23. Abil ity of paper ^to handle erasures. ^ 

24. Clear, concise, instructions for Independent use by students'. 

25. High interest low vocabulary with appropriate illustrations 
for a variety of age levels. . * ^ 

26. Material^ geared toward self conc^ 

• 27. Material geared to relevance for students , riot adul ts . 

28. Material with an emphasis 3n essent\^l cortipetericies . 

29. Material geared toward life skills. 
* 3d. Format of hi gh^school level. 

' 31. High school subject matter written lj)w vocabulary. 

32. High school subject low comprehension wi th Visual ren riforcemerit. 

33. High school subjects with alternate ass.igriments tb questions. 
^ 34. Word problems--math that looks adult but low achievemerit. , 

35: Books do not have grad^ levels oh the covers. 

36. eost of material. - ^ •. * 

37. Re-^ability of material . 

38. - DurSBility of material . 1 

39. terigth of time it cam be used. J 

40. Number of units of instructiori. _ [ - 

41. Quantity urn ts (classes are less thanUO students). 

42. Publishers response to questions. ] 

43. Appropriateness of material. _ _ 

44. Time span between ordering and receivirig is minimal 
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The .importance. of uncluttered material. 
Firsthand *lchowl(?dge of materials. 

Input fr^m teachers oh Materials; V • = 
Input from students. ' ^ ' 4 

Pfrceptu^ny elear' illustratiohs. 
Ehrbnalogieally ^pprbpriatd' illustrations. 
. Pereeptually appropriate printing. 

' Row fmportaht is ;it to have a selection of material on a 
hbrfzbhtal basts.. . ^ ' 

fivailabtl ity _of program' as a computer software item. 
Simplicity of material. 

Suggested methods for, adapting to othe-r populations. 
Reported, preferetfce by teachers who use the material. 
The degree to which it can be nibdified if hecessaryt 
Type Used in elementary Tevel^iateri als larger than 
stahdaird typel __ ^\ 

Black and while illustrations. - / 

Color keyed mMerlals. _ _ . . 

Preview and US: e of materials for several weeks by borrowing ^ 
from State Mgxerjal Centers. 
Role models for handicapped. 

Stereptypihg of sexeSi_races^ handicapped cdnditibhs. 
Material that cart, be cleaned easily.^ 
Cdmpdnents that can be handled by a spastic child. 
Materials thatare durable and can stand abuse. 
Materials stimulate interest and student motivated ideas 
and projects. . 
Material is ineJcpensive. 

Is the juaterial designed ^as the basic care of an instructional 
area or is it to be used as^a supplemehtary material only. 
The material uses as many of the sjUidents senses as possible 
(e^g. touch, sight, etc.). ^ 
The modality to which it is geared. 

Individuality of .'instructional tas'k suited for individual needs. 
Activities easily interchangeable from individual to group 
situations. ' - ^ 

Mul-ti-sensory approaches for learning tasks. 
Is ^ft fun. ^ - 

Hardback cover that^could be used in sequence fmpi year to year. 
Adaptability of materials across^age and grade levels. 

Availability of sales representative. . , " 

If I can get di tto mastej's and not just make thermal stencils only 
When students are mains treamed do materials meet guidelines for 
requirements taught inregular education. 

Materials should provide publi^shers evalijative lists for teachers 
to evaluate effectiveness rOf materials. • • 
Bpihion checklist from students. 

PriceL^reasbhable. ■ * • . 

Multisensory compohehts of material ^i.e. cassettes to accompany 
bobks-mani pul a ti ves ) . 
Btir;pbil ity. 
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87. Materials for secopdary studehts need to look more mature. ^ 
^88. Relativity ..to dver)lapping handicaps. 

"^89. Relativity to multi-hdndi capped. . . . ;/ 

90. h What type paper are the materials printed brii - will light 
; glare on it. . [ 

91. Are the materials cdnsUmerable (sic). 

92. Physically as well as academically appropriate. 

93. Type and purpose of material - processing versus achievement 
versus survival skills. ' 

94. Material developed andjbased upon sound L.D. and learning* theory . 

95. Appropriate to addlescfrits. ' 
^ 96. Parefit related actlvii^es for reinforcement and fun. 

97. Highly manipulative materials Using concrete objects, from child's 
environment. ' 

98. Several, activities designed to teach and reinfc)rce the dbdective. 

99. More materi'als in. all academic areas for secondary students. ' 

100. : Dittos without too much on a page. ' 

101. Dittos withciut finf print. . 

102. Ability for child to work independently with the product. 
103.. NDn-consumaBi li ty of the product. • 

104. Do the , students enjoy^usihg tfie ^material . 

105. Do the students see t§e. relevffhce . ' ■ ^ 

106. Viry structured. ^ . S 

107. ^ Mu]tisensory_ approach. - \ 

108. Use of direct teaching techniques. \ 

109. The price of rep] acement_parts._ - \ • • 

lid. Material is appropriate to- students needs as^ stated by M.D.T. 

and I.E. P. 

111. Materials a^ppli cable for every d^^ 

112. Straightfoyward^ realistic approa^ no B.S. 

113. Material prese^nts one concept at a time. 

114. Ease with which the material can be handled by young 
(5-7 year old) students. , . 

115. Rel^ation to mainsti^am curriculura. - 

116^ Variety of modes of evaluation of objectives. 

117. Task evaluation and provision for^evaluation of each 
individual tack. ' 

118. Materials whibh will not date themselves too soon. ;: ' 

119. Instructional levels are readily available on all materials. 

120. Whether material is on a state adapted list. 

121. Whether approach is a "new twist" based on sound accepted theory. 

122. Humber and sizes of .multiple pieces. 

123. Turriarburid time bh filling ofderst 

124. Whether materials^ guide has- an active role for parents section 
br suggestibhs.' _ _ . " 

125. Whether there is a local publisher's rep to answer questions 
arid assis^t iri training. _ _ _ 

125. Format bf_ mate rial matches maturity level of students. 

127. Cost irivblved iri bririgirig iri consul tarits (for teacher inserviee). 

128. Format cbris is terit with studerits physicff^ and social development 
as well as merital abilities. . 

129. Degree to which salesmari starids t|ehirid his prbdticti 
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'130.: earner education emphasis; ^ 

131. Eonpelation wi th "regular" secondary program to mininiize r 
differences. ^ ^' 

132. Suitable for large populations. J, . 

133. The uie of photographs^rather than artists illustrations. . ^ 

134. U^e of humorous photographs rather than hurtitfrous artists 
illustrations. ^ - 1 

135.. Material meeting the heeds of vodational aS well as basal " ^ 

_ ' academic skills. : • . ^ 

136. ^ Cassette. read along tapes for all regular education textbooks - 

all levels. • ' _ 

137. More high interest,' low vocabulary materials for upper high 
-school students, especially prepared for 1st, 2nd, 3rd grade 

^ reading level . 'I - _ " * ~^ 

138. Linguistic level (primarily syntax) , ^ . ^ 

139. Materials arid^kits should have reprodueable (sic) worksheets. 

140 . Non- cdniUmabl e . 

141. Copyable. 

142. Cheap. * \ i _^ _ : : 

143. Encduraprnen\^bf flexible thinking^ - 

144. Encouragement of fluent thirikirig._ ^ . 

145. Provision for use of creativity of thinking and special 
talents in performance skills^.. ,* _ 

146. Practical applicatidris of all" TO intrdduce.d. 

147. If the •material corTSu hi cates the intended concept well. 

' 148. The use of simple terms and phrasing (but not* redundant) . 

149. If the examples Used are easy' ITor the teacher or sfedent to 
demonstrate visually. ; / . " 

150. ' Material or repair accesSaBt^ity. ' , ' , 

151. Appealing or attractiveness of cover. \ ' ' 

152. The arjiount of information i.e, the material given in the catalog. 

153. Can the stydent use the materia] ihdgperideritly . 

154. Is it suitable for a learning cehter-wdrk situation approach. 

155. How much teacher. guidance is required with the student. 
15.6. Can a paraprofessional set up aW monitor the materials. 

157. Is the purpose to motivate and supplement - or is it necessary . 
to achieve tgP objectives. y 

158. Material designed for skill does^ not depend on 
success in another skill (you don't^have to. read to do math). • 

159. Material is not labeled with a specific grade. \ _ _ _ __ \ 

160. Pictures or stories donot indicate a younger age child than I x 

usfng the material for. ^ , ' 

161. Pictures of actual materials^shown in catal^^g so I can judge 
appropriateness of material for my students. - , * ' 

152. Hi gh^ interest, low vocabulary in every area: social studies, 

; science. ^ _ 

163. Uhiform readability level' th^ug^out material' or gradual increase- 

154. Selectid-ri of matenal^is also determined by the availability of • 
funds to purchase material. ' 

155. Speed with which materials- can be obtained fro.m cogipany. 

155. Bcide of learning involved as visual^, muH ' ; 

157. If printed, amount on page, type of print, etc. 



1B5 

w 



V 

\ 




^ .187 

' 168. Relates to^sgcip-economic grdup(5) in our cbbperative. 
169, Publisher states formula used to comput^x readabil i ty . 
^ I7d- Opportunity^ to try the niaterial on a trial basis. _ 

171. .Materials that cover a 3-'5 grade equiyaleh* so all of my . 
students woulcP benefit <^ ' / _ - ^ 

172. Materials designed for practical applidatibh to daily living 
- skilly. . . ^ / : ^ 

173. Materials providing aiternatives to paper-pencil ta^Jcs; 

174. - Suitable for ruray^communlty -^that has IRC settihgs\K-8 * 
V in one classroom.^ \^ . 
^175. Adaptable ftp any age level . / / _ 

176. Provision to match material to r^ylar education s^pdards; 

- 177. ^Preview pf what is to be learned. 

178. Biscussj.pn questipns for concept. 

179. tehgth of sentencestructure. 

180. Date of inustratipn.. 
. 1811 Eohcept presentation to student maturity, 

182. Cost effectiveness. / ' 
183; Sample pages-free (books). _ ^ 

184. Bi^h interest- low vocabuUry reading level. y 

185. Priee compatible with admi njstratpr. \- . J , : 

186. Utilizes skill and ability strengths alniaiiy possessed by student. 

187. Stories about area child lives in (no inner city stories). 

188. Cost of material. . • 

189. Sel^t materials that teaches skills- that have practical 
: _ '^pp^eatibh. , 

190. The product has asthetic Xsic) Appeal. ; 

191. Th^ Sase with which the product can be correlated to e;<isting ■ . 
iBatejnal . ' ^ ^ 

192: Timej^quired 'by to vprocess. my order. , - * ' 

193. Lbca^'R^s^vicing available. T 

194. Has pictures. x 

195. .Durability. _ - ^- ^ / . 

196. ^ Materiial developed to meet specific needs (ej^^ sound/symbol). '- '^ ' 
19>. Prdvisibhs to_share evaloatibh with parents at lEP.- r 

198. Previous Use/familiarity with cbntehtsV ' r -/ 

199. Experienced success with material. • ^ t 

200. Ea§e with which the material can be cleaned. ' 

^01. Can material product, meet nxn^ than 1 objective of student. n 
•202i^ Other colleagues falThH^^H:^^ and r^cbntnehdations for use of * ^ 

matiVial. . - ' : ^ _ ' ' - * 

203. Home-Study t^lated reinforcement materials. 

204. "The ease with , which a cfosrs age /tutor might employ materia • 

205. ^ Provision for developing positive attitudes, toward the hee'd 

, and use of material^ " • * 

206. . Provision for helping studerit(s) see practical daily application' 
^ of skip buildtfeg material. * - s 

"207.^ Provision for nranipulative or social e>:Refiences to motivate . 
' and reinforce skills* concepts ^ or lindefstandfhgs . 

208. E>:amples of areSs- in. which target skill can be- used or for ^ 
"^which it is a prereguisi te. ^ ' 

209. Provision for creative e^ntion (.siV) of skills. 
21d. Shows little fig[iire groumi confusion. 
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211.. Can be "Used by an aide. 

212. • AQtivities j:dm6ine both auditory arid visual indtle. . 

213. Lartguage levels. y! _ . ^ 

. 214. Odd language or Use of slang or fdipms. - : - : 

215. Age appropriate material . 

216. Do you.feel that* teacher made niaterial are- more impbrtarit 
than s.tore bought goods. 

217. The child can operate i complete materials dri their own. 

218. Teaches children responsibility Ih taking care of material. 

219. Allows children immediate gratificatidri. . ' 

220. Is materiaJable to allow success fdr each stUderit at student's 
level ot ability. • 

221. Is child's self image improved with use df material . 

222. ^ Whether students have used materials in previdUsygafs . 

. 223. Available in small parts.* no need td buy for whole^'class size. " 
224.' Reputation the use- of material has earned withiri my class after 
a year. .; . . 

ar_c] as.srogm .teachers' comments on specific stUderit 
progress in a -given area on a particular material. 
Nearby col lege- univiBr^ity, professor suggestidris.* 
Graduate students suggestions in graduate college classes. i 
Evidence that the material provides for varying inputs, and 
response modes. ^ , 

Illustrations that ai^ realistic, s 

Availabili;^ of materials that ra,nge frbm 1 to* a maximum of 

6 stimuli per page^ ^ ^ * . 

Availability of materials that are v^js^^ simple in format. 

Hach more hands-on type material". ^ • ; _ * 

More. articulation-drill type materials at varying degrees of 
difficulty both in format arid grade-level interest. 
Materials are age appropriate. ^ ju- 

Ebntent appeals to large variety of students. 
Sensory mode required. " . 
Do the stated or implied objectives match my iriterit for 
the material . _ ' 

Is^.the sequence thorough and irnSlagieal order. 
Anx)unt of adaptatibri required to fit my needs. 
Ease wicth which the material cari be modified. .__ 
Program provides teaching of prerequisite sRi'lls iFound • 
deficierit (sic) well iritd program. _ _ 
Varidus.^eritry levels iri same program for late enrol Imerit i .e. 
ilnTike Corrective .Reading. . . _• t ^ 

243. Truthful arid helpful jriformatibri in catalog atis. _ z:^^. 

244. Emphasis dri adolescents iri JUriior High, i.e. not 5th grade 
» ^ elementary students. . • 

245. Materials ability td'be taught at home by parerits i^ make Up ^ 
si tuatidris. 

246.. The riumber df.ability levels the material cdvers. , , ^ 

247. Reproducible wdrksheeli. 

248. Provisidri fdr a variety- of written respdhses& .1 

249. Prxivides for all modali ties' df learrjing. . ; 

250. The price is justified by a great adaptability td^varid'^us areas 
: of instructidri arid types -of studints. - " 



225. Regul 



226. 
227. 
228. 

229. 
230. 

231'. 
232. 
233. 

234^ 
235. 
235. 
237. 

238.' 
239. 
240. 
241. 

242. 
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, ^ 251. Begree to whietv -mate rial instructs survival sktUs. 

252. Banner material is sp^ed on page (for work room), 

253. Simpl^ieity of Tangdage used (understajidabil i ty)^_ ' ^ 

254. Pii^lJsfier's permission to ditto certain "component" parts, } 

255. phei^ecti veness of the roaterials reported by other professionals 
to me. 

255." . . GohceptsLfare broken up into very fine steps^ 

257. .Several ^teps can be combined for a faster student^ _^ 

258. Concepts are very oVearly stated (e.g. CVe stands for consonant 
vbwe 1 CO ns b ha h t ) . 

259. Availability of 'the material . • 

260. Catalog clarity of qcleseription. 

^61. Catalogs. received in spring prior to March 1 for ordering. 

262. Low level reading materialg (2.0-3,0) grade level 

263. Materia Is -that allow student independence. 
264; » Range of levels for progression. 

"265. •Student reaction dliririg preview period. 

266. Free. of elaborate equipment. 

267. •Usable by aides. 

268. Provisidh for evaltJBtibh of retention - 
'269. Prbvisibh for sufficient drill. t 

270, Self teaching _ _ V ^ ' 

27L; High i htgrest ^08/ vocabulary material specifically ^.esighed to 
appeal to aunipr high learhihg disabilities. _ ; 

High interest low vbcabul arpT materials bh mbtbrcycl^Sj sjDbrts, 
mysterieSi space* adventura^^^^ it bf hot" type stories. 

Paperback books* high ihtg^st.low vbcabulary with accompahying 
questions »and worksheets . } 
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APPENDIX N 

Subjects' CojnmeritS' About the Process* of ^ 



Selecting Instructional Materials 
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Numbe^of 



P6rsona1 n^eds regarding appropriate materials 
Explanation of responses to survey 
Worth, eoheisehess of survey 
'Gbst/expehse of instruetiohal materials 
Preview policies 



ebmnehts. about publishers 



v- ■ 

Heed for training in ^selecting ihstroetional 
materialsv • ^ 

Sources used to obtain materials 

to select quality teachers 



122 
29 
23 
14 
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